Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

gpu kernels on on my computer writing other gpu kernels for the same chip to simulate 100ks of particles, each an agent + neural network sensing K bg fields and allocating energy to A actions, at 1000s steps/s, for thermodynamic artificial life i think maybe not a bubble lads

Fraser Price

1,184 subscribers

32,595 Aufrufe • vor 14 Tagen •via X (Twitter)

Gesundheit & Wellness Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today I release new GPU Particle Volumes system and the GPU Snow Particle shaders for it! This snow shader can render hundreds of thousands of particles at the same time even on a weak GPU. It also supports VRC Light Volumes. Get it on my Booth or Patreon!

Today I release new GPU Particle Volumes system and the GPU Snow Particle shaders for it! This snow shader can render hundreds of thousands of particles at the same time even on a weak GPU. It also supports VRC Light Volumes. Get it on my Booth or Patreon!

RED_SIM

43,586 Aufrufe • vor 7 Monaten

It's here: We just hit superhuman performance on AI kernel optimization! Real customer models & production settings. Not toy problems (what I typically see). This is the year that Claude writes its own kernels, Codex its own kernels, for every new GPU that it wants to run on -- something that takes months to port between GPU generations today. This has a massive impact to scaling intelligence. More compute means getting the next frontier model sooner.

It's here: We just hit superhuman performance on AI kernel optimization! Real customer models & production settings. Not toy problems (what I typically see). This is the year that Claude writes its own kernels, Codex its own kernels, for every new GPU that it wants to run on -- something that takes months to port between GPU generations today. This has a massive impact to scaling intelligence. More compute means getting the next frontier model sooner.

Sharon Zhou

240,793 Aufrufe • vor 4 Monaten

Ex-NVIDIA engineer who built Unsloth explained RL, kernels, reasoning, quantization, and agents in 2 hours 42 minutes - better than $5000 fine-tuning bootcamps. pick the base model -> write triton kernels for 2x faster fine-tune -> quantize to 4-bit -> run GRPO/DPO -> ship a reasoning model on your single GPU. That loop is why Unsloth is the default way to fine-tune Llama, Qwen, Gemma, and Phi on hardware you already own. Unsloth + Triton kernels + 4-bit quantization + GRPO/DPO + single-GPU fine-tuning - that's the stack. Watch and save it, then fine-tune your first model tonight.

Ex-NVIDIA engineer who built Unsloth explained RL, kernels, reasoning, quantization, and agents in 2 hours 42 minutes - better than $5000 fine-tuning bootcamps. pick the base model -> write triton kernels for 2x faster fine-tune -> quantize to 4-bit -> run GRPO/DPO -> ship a reasoning model on your single GPU. That loop is why Unsloth is the default way to fine-tune Llama, Qwen, Gemma, and Phi on hardware you already own. Unsloth + Triton kernels + 4-bit quantization + GRPO/DPO + single-GPU fine-tuning - that's the stack. Watch and save it, then fine-tune your first model tonight.

h100envy

487,633 Aufrufe • vor 10 Tagen

I implemented Google Research's TurboQuant as a CUDA-native compression engine on Blackwell B200. 5x KV cache compression on Qwen 2.5-1.5B, near-loseless attention scores, generating live from compressed memory. 5 custom cuTile CUDA kernels ft: - fused attention (with QJL corrections) - online softmax -on-chip cache decompression - pipelined TMA loads Try it out: s/o Bryce, the CUDA Colonel and the cuTile team at NVIDIA for lending me Blackwell GPU access :) cc sunny madra Gavin

I implemented Google Research's TurboQuant as a CUDA-native compression engine on Blackwell B200. 5x KV cache compression on Qwen 2.5-1.5B, near-loseless attention scores, generating live from compressed memory. 5 custom cuTile CUDA kernels ft: - fused attention (with QJL corrections) - online softmax -on-chip cache decompression - pipelined TMA loads Try it out: s/o Bryce, the CUDA Colonel and the cuTile team at NVIDIA for lending me Blackwell GPU access :) cc sunny madra Gavin

ani

807,497 Aufrufe • vor 3 Monaten

every other day i yearn for more research fields to adopt the culture from the ML and ML adjacent fields of building a demo website for each paper and put code on github

every other day i yearn for more research fields to adopt the culture from the ML and ML adjacent fields of building a demo website for each paper and put code on github

outside five sigma

27,352 Aufrufe • vor 9 Monaten

$Announcing the limited alpha release of our GPU marketplace, with $50 in free credits for 100 selected testers—apply now for a chance to participate! 🤘🏼🌪️ Hyperbolic’s GPU marketplace optimizes global GPU infrastructure, aggregating resources from data centers, mining farms, personal machines, and on-prem setups to make GPUs accessible at a fraction of the cost. Apply to gain access:$

Announcing the limited alpha release of our GPU marketplace, with $50 in free credits for 100 selected testers—apply now for a chance to participate! 🤘🏼🌪️ Hyperbolic’s GPU marketplace optimizes global GPU infrastructure, aggregating resources from data centers, mining farms, personal machines, and on-prem setups to make GPUs accessible at a fraction of the cost. Apply to gain access:

Hyperbolic

26,202 Aufrufe • vor 1 Jahr

THE MS-A2 IS THE MINISFORUM BOX HERMES AGENT WAS NEVER MEANT TO RUN ON, AND THAT'S BY DESIGN The MS-S1 MAX earns its spot running Hermes Agent because of one thing. 128GB of unified memory, up to 96GB of it handed straight to the GPU. That's the only reason a 120B model fits and runs locally for $0 a month The MS-A2 solves a different problem. Ryzen 9 9955HX, 16 cores, 32 threads, up to 96GB of regular DDR5-5600, no unified pool Three M.2 PCIe 4.0 slots, one U.2, two 22110. Dual 10Gbps SFP+ LAN plus 2.5G. WiFi 6E. Bluetooth 5.3. A slide-out motherboard for fast upgrades. A real PCIe x16 slot that actually takes a low-profile GPU That last part is where the two machines split for good. The MS-S1 MAX's PCIe slot won't take a GPU at all, every bit of GPU power has to come from the unified chip itself. The MS-A2 trades that unified memory trick for raw expandability instead One box runs a local AI agent. The other runs a home lab that needs storage, networking, and room to grow. Minisforum built both on purpose, not as the same product wearing two names

NO1ennn

25,119 Aufrufe • vor 29 Tagen

you can't tell me AI isn't a game changer for programming it's connecting over webrtc the screen is made of 16 by 16 regions each region is 256 by 256 ive come up with a custom encoding I spam UDP packets for each reigion for each client each region is designed to fit in a single packet the next state of the simulation is computed in my GPU using cuda the cuda is linked to golang the program manages a double buffer this is so that the network broadcastloop doesn't contend with the cuda update for the object when you write it sends a udp packet for every mouse event i manage a stream to update it on my gpu the client takes each packet and has custom webgl to update the regions and render everything in a single pass. texture 3d

you can't tell me AI isn't a game changer for programming it's connecting over webrtc the screen is made of 16 by 16 regions each region is 256 by 256 ive come up with a custom encoding I spam UDP packets for each reigion for each client each region is designed to fit in a single packet the next state of the simulation is computed in my GPU using cuda the cuda is linked to golang the program manages a double buffer this is so that the network broadcastloop doesn't contend with the cuda update for the object when you write it sends a udp packet for every mouse event i manage a stream to update it on my gpu the client takes each packet and has custom webgl to update the regions and render everything in a single pass. texture 3d

kache

97,819 Aufrufe • vor 1 Jahr

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

PowerInfer - a high-speed inference engine for deploying LLMs locally. Just came across this super interesting project on speeding up inference. It's not MoE but it's a simple approach that exploits the high locality in LLM inference to design a GPU-CPU hybrid inference engine. Hot-activated neurons are preloaded onto the GPU for fast access, while cold-activated neurons (the majority) are computed on the CPU. This approach significantly reduces GPU memory demands and CPU-GPU data transfer. It achieves an average token generation rate of 13.20 tokens/s, with a peak of 29.08 tokens/s, across various LLMs on a single NVIDIA RTX 4090 GPU. It's on only 18% lower than that achieved by a top-tier server-grade A100 GPU. It also significantly outperforms llama.cpp by up to 11.69x while retaining model accuracy. There is a lot more innovation around inference that's coming fast. Really encouraged by the study on sparse computation to enhance the computational efficiency of LLMs. It's now possible to use PowerInfer with Llama 2 and Faclon 40B. Mistral-7B support is coming soon!

elvis

261,622 Aufrufe • vor 2 Jahren

AMD's Anush Elangovan explains why he thinks his company's open source ethos combined with agentic AI superpowers their leverage as a company: Because AMD publishes a lot of technical details about its hardware, when engineers use AI tools, the models already “understand” AMD’s systems and can help write code for them, debug them, or even generate new tools. And that makes developers more productive on AMD hardware without AMD having to do all the work internally. "AMD has had this ethos of open source, which really plays to our advantage. Every frontier model that I use has already seen every bit of AMD source code." "It'll rewrite my spec for me because it's already in the training data. Which you can't get from closed ecosystems." "In fact I built a virtual GPU simulator just based off our public specs, and now I'm running it on the GPU. So now I can run cross-generational GPU simulations on existing hardware." "We have that advantage. And we've run a Dev Day contest where we generated more tokens on AMD — Triton kernels and HIP kernels — than existed on the internet at the time." "So now that's all part of the pre-training data. It's a superpower because now you're open source, and you're agentically accelerating this process."

AMD's Anush Elangovan explains why he thinks his company's open source ethos combined with agentic AI superpowers their leverage as a company: Because AMD publishes a lot of technical details about its hardware, when engineers use AI tools, the models already “understand” AMD’s systems and can help write code for them, debug them, or even generate new tools. And that makes developers more productive on AMD hardware without AMD having to do all the work internally. "AMD has had this ethos of open source, which really plays to our advantage. Every frontier model that I use has already seen every bit of AMD source code." "It'll rewrite my spec for me because it's already in the training data. Which you can't get from closed ecosystems." "In fact I built a virtual GPU simulator just based off our public specs, and now I'm running it on the GPU. So now I can run cross-generational GPU simulations on existing hardware." "We have that advantage. And we've run a Dev Day contest where we generated more tokens on AMD — Triton kernels and HIP kernels — than existed on the internet at the time." "So now that's all part of the pre-training data. It's a superpower because now you're open source, and you're agentically accelerating this process."

TBPN

34,469 Aufrufe • vor 2 Monaten

We are excited to share a deeper look into the GPU Sharing Platform that will power AI applications on the InfraX V4 DApp. In this demo we showcase a GPU running and completing an image generation task. Our backend successfully leverages this GPU (and CPU) in real time to complete the job, earning the user money, and powering the infraX platform. Here’s how it works 👉 when you connect to the InfraX DApp, our platform automatically detects the GPU on your machine and immediately checks it eligibility and where it can be used. From there, each user dictates exactly how and when they want to contribute their GPU power by setting the days their PC is most available (throughout the night, for example). Additional, each user will be able to pause their GPU's connection to infraX whenever they need to use it locally, resuming with a just a single click. Once activated, your GPU seamlessly plugs into the InfraX network and begins fulfilling compute jobs, earning YOU money. Go on, take the $INFRA pill..

We are excited to share a deeper look into the GPU Sharing Platform that will power AI applications on the InfraX V4 DApp. In this demo we showcase a GPU running and completing an image generation task. Our backend successfully leverages this GPU (and CPU) in real time to complete the job, earning the user money, and powering the infraX platform. Here’s how it works 👉 when you connect to the InfraX DApp, our platform automatically detects the GPU on your machine and immediately checks it eligibility and where it can be used. From there, each user dictates exactly how and when they want to contribute their GPU power by setting the days their PC is most available (throughout the night, for example). Additional, each user will be able to pause their GPU's connection to infraX whenever they need to use it locally, resuming with a just a single click. Once activated, your GPU seamlessly plugs into the InfraX network and begins fulfilling compute jobs, earning YOU money. Go on, take the $INFRA pill..

infraX | $INFRA

30,615 Aufrufe • vor 10 Monaten

Stress testing Metropolis 1998! - Population: 53,500 - CPU FPS: 80 - GPU FPS: 10-80 - RAM: 3,100 MB So: At the moment, the game is GPU bound. I know why and there's a lot of room for improvement. It will involve developing or customizing an existing GPU framework. There's also a lot of room to improve CPU/RAM, but right now it's in an okay place. #gamedev

Stress testing Metropolis 1998! - Population: 53,500 - CPU FPS: 80 - GPU FPS: 10-80 - RAM: 3,100 MB So: At the moment, the game is GPU bound. I know why and there's a lot of room for improvement. It will involve developing or customizing an existing GPU framework. There's also a lot of room to improve CPU/RAM, but right now it's in an okay place. #gamedev

Yesbox - Metropolis 1998

84,873 Aufrufe • vor 1 Jahr

Hey everyone, today I want to introduce a project that’s aiming to redefine how we access compute for AI — it’s called GPUAI. 🔶 GPUAI: Unlocking Global GPU Power for the AI Era GPUAI isn’t just another GPU marketplace or leasing service. It’s a fully decentralized protocol that connects idle GPU resources around the world — from gaming PCs to data center clusters — and transforms them into a high-performance compute network for AI workloads. 🧠 Why does it matter? Right now, the biggest bottleneck in AI isn’t algorithms — it’s access to compute. Training and running models requires massive GPU power, but it’s locked up in centralized cloud platforms, expensive and hard to access for smaller teams. With GPUAI, anyone can tap into a global GPU pool that’s: ✅ Fully decentralized ✅ Reputation-based and smart contract coordinated ✅ Encrypted and secure ✅ Token-incentivized — meaning contributors get rewarded in $GPUAI 📈 For developers, it’s a flexible way to access GPU compute for training, inference, and more — without cloud lock-in. 💰 For GPU owners, it’s a chance to monetize idle hardware that would otherwise go unused. The protocol is live, the apps are active, and the ecosystem is growing fast. 🌐 Try it yourself at 📖 Learn more on 🎮 Play our community games at This is real infrastructure for the future of AI, not hype. Follow them and explore their mission of decentralized computing at Tell me what you think - if you have a GPU, you can start profiting now. #GPUAI #Web3Infrastructure #AIComputing #DePIN #Decentralization

Hey everyone, today I want to introduce a project that’s aiming to redefine how we access compute for AI — it’s called GPUAI. 🔶 GPUAI: Unlocking Global GPU Power for the AI Era GPUAI isn’t just another GPU marketplace or leasing service. It’s a fully decentralized protocol that connects idle GPU resources around the world — from gaming PCs to data center clusters — and transforms them into a high-performance compute network for AI workloads. 🧠 Why does it matter? Right now, the biggest bottleneck in AI isn’t algorithms — it’s access to compute. Training and running models requires massive GPU power, but it’s locked up in centralized cloud platforms, expensive and hard to access for smaller teams. With GPUAI, anyone can tap into a global GPU pool that’s: ✅ Fully decentralized ✅ Reputation-based and smart contract coordinated ✅ Encrypted and secure ✅ Token-incentivized — meaning contributors get rewarded in $GPUAI 📈 For developers, it’s a flexible way to access GPU compute for training, inference, and more — without cloud lock-in. 💰 For GPU owners, it’s a chance to monetize idle hardware that would otherwise go unused. The protocol is live, the apps are active, and the ecosystem is growing fast. 🌐 Try it yourself at 📖 Learn more on 🎮 Play our community games at This is real infrastructure for the future of AI, not hype. Follow them and explore their mission of decentralized computing at Tell me what you think - if you have a GPU, you can start profiting now. #GPUAI #Web3Infrastructure #AIComputing #DePIN #Decentralization

The Crypto GEMs

69,984 Aufrufe • vor 1 Jahr

The Way Forward & A New Chapter For AI powered by GamerHash AI & $GHX. Welcome to the future of bleeding edge connectivity and cloud infrastructure ⚡ GamerHash AI is the answer to the billion dollar question on how to offset the GPU scarcity, enable exponential growth of AI through utilizing consumer-level GPUs and establishing a powerful sharing economy by sourcing a global network of gamers. The synergy of our GPU #DePIN and blockchain for #AI #inference is the technology of the future that already works today. See you in the network!

The Way Forward & A New Chapter For AI powered by GamerHash AI & $GHX. Welcome to the future of bleeding edge connectivity and cloud infrastructure ⚡ GamerHash AI is the answer to the billion dollar question on how to offset the GPU scarcity, enable exponential growth of AI through utilizing consumer-level GPUs and establishing a powerful sharing economy by sourcing a global network of gamers. The synergy of our GPU #DePIN and blockchain for #AI #inference is the technology of the future that already works today. See you in the network!

GamerHash AI

1,866,164 Aufrufe • vor 1 Jahr

DeepSeek-v4 now runs at ~23-26 tok/s on MLX! I made some custom kernels for the sinkhorn and it took gen speeds for 17 -> 26 tok/s. The weights are also significantly smaller thanks to Pedro Cuenca tip about keeping the experts in MXFP4! Now you can use it to power your local coding agents (PI, Open code, Hermes agent or even CC) PR:

DeepSeek-v4 now runs at ~23-26 tok/s on MLX! I made some custom kernels for the sinkhorn and it took gen speeds for 17 -> 26 tok/s. The weights are also significantly smaller thanks to Pedro Cuenca tip about keeping the experts in MXFP4! Now you can use it to power your local coding agents (PI, Open code, Hermes agent or even CC) PR:

Prince Canuma

58,451 Aufrufe • vor 2 Monaten

WATCH: "I am going in with a little chip on my shoulder, but also blessed at the same time for this opportunity to keep on playing football." Over the weekend, Davenport Football player Sy Barnett became the first Panther to EVER sign with an NFL team as an undrafted free agent.

WATCH: "I am going in with a little chip on my shoulder, but also blessed at the same time for this opportunity to keep on playing football." Over the weekend, Davenport Football player Sy Barnett became the first Panther to EVER sign with an NFL team as an undrafted free agent.

Mark Skol, Jr.

19,527 Aufrufe • vor 3 Jahren

“I do not think it is a coincidence that the writing of a woman brought me here. I am so grateful to the women in my life. I cannot overstate the importance of intersectionality to me. We need to look for friends and allies here, and not enemies.”

“I do not think it is a coincidence that the writing of a woman brought me here. I am so grateful to the women in my life. I cannot overstate the importance of intersectionality to me. We need to look for friends and allies here, and not enemies.”

Jacob Tierney Updates

37,050 Aufrufe • vor 3 Monaten

I created a web app for teaching computer vision basics, allowing users to upload an image or video stream and instantly view it as a numerical pixel matrix, with options to display values in RGB, Hex, or Grayscale formats. It features predefined convolution kernels applied in real-time: - Sobel operator for edge detection (computes gradients to highlight boundaries) - Gaussian Blur: averages neighboring pixels with weights to reduce noise - Sharpen: boosts local contrast to enhance details This setup clearly visualizes how images are represented as matrices or tensors, how convolution slides kernels across pixels, and how operations like gradient computation, blurring, or sharpening modify the data step-by-step. I plan to use demos like this in my upcoming computer vision course to build intuition for fundamental image processing concepts, OpenCV filters, and CNN building blocks (e.g., why kernels extract features).

I created a web app for teaching computer vision basics, allowing users to upload an image or video stream and instantly view it as a numerical pixel matrix, with options to display values in RGB, Hex, or Grayscale formats. It features predefined convolution kernels applied in real-time: - Sobel operator for edge detection (computes gradients to highlight boundaries) - Gaussian Blur: averages neighboring pixels with weights to reduce noise - Sharpen: boosts local contrast to enhance details This setup clearly visualizes how images are represented as matrices or tensors, how convolution slides kernels across pixels, and how operations like gradient computation, blurring, or sharpening modify the data step-by-step. I plan to use demos like this in my upcoming computer vision course to build intuition for fundamental image processing concepts, OpenCV filters, and CNN building blocks (e.g., why kernels extract features).

Marco Franzon

270,367 Aufrufe • vor 6 Monaten