Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

gpu kernels on on my computer writing other gpu kernels for the same chip to simulate 100ks of particles, each an agent + neural network sensing K bg fields and allocating energy to A actions, at 1000s steps/s, for thermodynamic artificial life i think maybe not a bubble lads

Fraser Price

1,191 subscribers

32,653 Aufrufe • vor 3 Monaten •via X (Twitter)

Gesundheit & Wellness Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Today I release new GPU Particle Volumes system and the GPU Snow Particle shaders for it! This snow shader can render hundreds of thousands of particles at the same time even on a weak GPU. It also supports VRC Light Volumes. Get it on my Booth or Patreon!

Today I release new GPU Particle Volumes system and the GPU Snow Particle shaders for it! This snow shader can render hundreds of thousands of particles at the same time even on a weak GPU. It also supports VRC Light Volumes. Get it on my Booth or Patreon!

RED_SIM

43,816 Aufrufe • vor 10 Monaten

It's here: We just hit superhuman performance on AI kernel optimization! Real customer models & production settings. Not toy problems (what I typically see). This is the year that Claude writes its own kernels, Codex its own kernels, for every new GPU that it wants to run on -- something that takes months to port between GPU generations today. This has a massive impact to scaling intelligence. More compute means getting the next frontier model sooner.

It's here: We just hit superhuman performance on AI kernel optimization! Real customer models & production settings. Not toy problems (what I typically see). This is the year that Claude writes its own kernels, Codex its own kernels, for every new GPU that it wants to run on -- something that takes months to port between GPU generations today. This has a massive impact to scaling intelligence. More compute means getting the next frontier model sooner.

Sharon Zhou

246,878 Aufrufe • vor 7 Monaten

I wrote GPU kernels for GPT2 124M inference engine from scratch in ~1500 lines of CUDA. Here I explain it simply.

I wrote GPU kernels for GPT2 124M inference engine from scratch in ~1500 lines of CUDA. Here I explain it simply.

ninjaHattori1

160,092 Aufrufe • vor 1 Monat

timelapse #164 (15.5 hrs) - Burning midnight oil with the Kimi team benchmarking on kernels - Getting a Persistent Fused Mega Kernel for a Puffer Lib Environment (the full Craftax game) - Dipped for the night to have models run my overnight training runs on autopilot, including some kernel-based GRPO on qwen3.6 - private contract work - downloaded 1.1 TB of minecraft videos to train a foundation model on - optimized my minecraft foundation model training pipeline and kernels to train on 500k hrs of 128px at 10 fps in ~28 hrs on single gpu (5 hrs of learning per second on rtx pro 6000 blackwell) - doing it for the love of the game

timelapse #164 (15.5 hrs) - Burning midnight oil with the Kimi team benchmarking on kernels - Getting a Persistent Fused Mega Kernel for a Puffer Lib Environment (the full Craftax game) - Dipped for the night to have models run my overnight training runs on autopilot, including some kernel-based GRPO on qwen3.6 - private contract work - downloaded 1.1 TB of minecraft videos to train a foundation model on - optimized my minecraft foundation model training pipeline and kernels to train on 500k hrs of 128px at 10 fps in ~28 hrs on single gpu (5 hrs of learning per second on rtx pro 6000 blackwell) - doing it for the love of the game

Elliot Arledge

28,210 Aufrufe • vor 3 Monaten

Ex-NVIDIA engineer who built Unsloth explained RL, kernels, reasoning, quantization, and agents in 2 hours 42 minutes - better than $5000 fine-tuning bootcamps. pick the base model -> write triton kernels for 2x faster fine-tune -> quantize to 4-bit -> run GRPO/DPO -> ship a reasoning model on your single GPU. That loop is why Unsloth is the default way to fine-tune Llama, Qwen, Gemma, and Phi on hardware you already own. Unsloth + Triton kernels + 4-bit quantization + GRPO/DPO + single-GPU fine-tuning - that's the stack. Watch and save it, then fine-tune your first model tonight.

Ex-NVIDIA engineer who built Unsloth explained RL, kernels, reasoning, quantization, and agents in 2 hours 42 minutes - better than $5000 fine-tuning bootcamps. pick the base model -> write triton kernels for 2x faster fine-tune -> quantize to 4-bit -> run GRPO/DPO -> ship a reasoning model on your single GPU. That loop is why Unsloth is the default way to fine-tune Llama, Qwen, Gemma, and Phi on hardware you already own. Unsloth + Triton kernels + 4-bit quantization + GRPO/DPO + single-GPU fine-tuning - that's the stack. Watch and save it, then fine-tune your first model tonight.

h100envy

497,788 Aufrufe • vor 3 Monaten

China’s frontier models already run on China’s own chips. “Remember, the GLM-5 paper is almost a year old at this point. They say: ‘From the first day, GLM-5 is full-stack adapted to Chinese GPU ecosystems. We have successfully completed deep optimization, spanning from underlying kernels to upper-level inference frameworks, across seven mainstream domestic chip platforms, including Huawei Ascend, Moore Threads, Hygon, Cambricon, Kunlunxin, MetaX and Enflame.’” “It’s not necessarily NVIDIA GPUs and kernels we’re talking about. They’re serving this model, at least they claim, for many months on seven different domestic Chinese accelerators.” “People thought it was impossible that it’s served on GPUs by a Chinese lab, because Chinese labs aren’t that GPU rich. But turns out they’re using Chinese hardware. They plumb through everything, the kernels, the systems, while serving those models efficiently.”

China’s frontier models already run on China’s own chips. “Remember, the GLM-5 paper is almost a year old at this point. They say: ‘From the first day, GLM-5 is full-stack adapted to Chinese GPU ecosystems. We have successfully completed deep optimization, spanning from underlying kernels to upper-level inference frameworks, across seven mainstream domestic chip platforms, including Huawei Ascend, Moore Threads, Hygon, Cambricon, Kunlunxin, MetaX and Enflame.’” “It’s not necessarily NVIDIA GPUs and kernels we’re talking about. They’re serving this model, at least they claim, for many months on seven different domestic Chinese accelerators.” “People thought it was impossible that it’s served on GPUs by a Chinese lab, because Chinese labs aren’t that GPU rich. But turns out they’re using Chinese hardware. They plumb through everything, the kernels, the systems, while serving those models efficiently.”

SemiAnalysis

44,762 Aufrufe • vor 13 Tagen

Ray tracing sound on the GPU (Work in progress). Since the whole game is running on the GPU, I found it convenient to do the sound management and the ray tracing on the GPU as well. Each frame the CPU receives a sound queue from the GPU to process, and applies effects like reverb

Ray tracing sound on the GPU (Work in progress). Since the whole game is running on the GPU, I found it convenient to do the sound management and the ray tracing on the GPU as well. Each frame the CPU receives a sound queue from the GPU to process, and applies effects like reverb

xima

19,839 Aufrufe • vor 2 Jahren

underrated gems in Kimi-K3 release: > an early K3 wrote the majority of the kernels in the late development stages > it built a triton-class compiler from scratch, MiniTriton, that delivers performance on par with or better than Triton and torch.compile > then it designed a chip, by a model, for a model, in one 48-hour autonomous run the model is rewriting and optimizing every layer of the stack it runs on: kernels for its own training. A compiler for its own kernels. silicon for its own weights. we're watching software build its own hardware

underrated gems in Kimi-K3 release: > an early K3 wrote the majority of the kernels in the late development stages > it built a triton-class compiler from scratch, MiniTriton, that delivers performance on par with or better than Triton and torch.compile > then it designed a chip, by a model, for a model, in one 48-hour autonomous run the model is rewriting and optimizing every layer of the stack it runs on: kernels for its own training. A compiler for its own kernels. silicon for its own weights. we're watching software build its own hardware

Alex Ker 🔭

311,780 Aufrufe • vor 3 Monaten

Nova uses an energy to enhance her cybernetics and weapons. Working closely with Quantum we were able to make a custom system using his gpu particles to bring this effect to life in #VRChat

Nova uses an energy to enhance her cybernetics and weapons. Working closely with Quantum we were able to make a custom system using his gpu particles to bring this effect to life in #VRChat

Meechu

15,753 Aufrufe • vor 1 Jahr

The rise of AI Agents is driving GPU demand to new heights. ⚡ At NodeAI, we’re scaling our decentralized GPU network across Asia, Europe, and the US to meet this growing demand. The AI Agent economy is here, and we’re ready to fuel it. #AI #GPU #NodeAI

The rise of AI Agents is driving GPU demand to new heights. ⚡ At NodeAI, we’re scaling our decentralized GPU network across Asia, Europe, and the US to meet this growing demand. The AI Agent economy is here, and we’re ready to fuel it. #AI #GPU #NodeAI

Node AI | $GPU

99,329 Aufrufe • vor 1 Jahr

I implemented Google Research's TurboQuant as a CUDA-native compression engine on Blackwell B200. 5x KV cache compression on Qwen 2.5-1.5B, near-loseless attention scores, generating live from compressed memory. 5 custom cuTile CUDA kernels ft: - fused attention (with QJL corrections) - online softmax -on-chip cache decompression - pipelined TMA loads Try it out: s/o Bryce, the CUDA Colonel and the cuTile team at NVIDIA for lending me Blackwell GPU access :) cc sunny madra Gavin

I implemented Google Research's TurboQuant as a CUDA-native compression engine on Blackwell B200. 5x KV cache compression on Qwen 2.5-1.5B, near-loseless attention scores, generating live from compressed memory. 5 custom cuTile CUDA kernels ft: - fused attention (with QJL corrections) - online softmax -on-chip cache decompression - pipelined TMA loads Try it out: s/o Bryce, the CUDA Colonel and the cuTile team at NVIDIA for lending me Blackwell GPU access :) cc sunny madra Gavin

ani

819,861 Aufrufe • vor 6 Monaten

CMU PhD who built the kernels NVIDIA now ships in TensorRT-LLM explained fast attention in 68 minutes - better than $1200 GPU programming courses. pick the attention pattern -> generate a fused CUDA kernel -> drop it into vLLM/SGLang -> same GPU, way more tokens per second. That loop is why FlashInfer now powers inference at NVIDIA, vLLM, SGLang, and half the serving stacks you use. FlashInfer + Triton + JIT-compiled kernels + paged-KV attention - that's the stack.

CMU PhD who built the kernels NVIDIA now ships in TensorRT-LLM explained fast attention in 68 minutes - better than $1200 GPU programming courses. pick the attention pattern -> generate a fused CUDA kernel -> drop it into vLLM/SGLang -> same GPU, way more tokens per second. That loop is why FlashInfer now powers inference at NVIDIA, vLLM, SGLang, and half the serving stacks you use. FlashInfer + Triton + JIT-compiled kernels + paged-KV attention - that's the stack.

h100envy

32,605 Aufrufe • vor 3 Monaten

We just open-sourced the world's fastest WebGPU kernels for 200+ machine learning operations. Specialized for your hardware. They run entirely locally in your browser. Now available on Hugging Face 🤗 Tell your agent to use @huggingface/kernels in your next project.

We just open-sourced the world's fastest WebGPU kernels for 200+ machine learning operations. Specialized for your hardware. They run entirely locally in your browser. Now available on Hugging Face 🤗 Tell your agent to use @huggingface/kernels in your next project.

Xenova

21,552 Aufrufe • vor 28 Tagen

every other day i yearn for more research fields to adopt the culture from the ML and ML adjacent fields of building a demo website for each paper and put code on github

every other day i yearn for more research fields to adopt the culture from the ML and ML adjacent fields of building a demo website for each paper and put code on github

outside five sigma

27,415 Aufrufe • vor 1 Jahr

Whenever I need a GPU, I go to HPC-AI and rent it for the lowest price you'll find. An H200 costs $1.89/hour. Compare that to AWS, where the same GPU costs $10.60/hour! No commitments. Pay as you go.

Whenever I need a GPU, I go to HPC-AI and rent it for the lowest price you'll find. An H200 costs $1.89/hour. Compare that to AWS, where the same GPU costs $10.60/hour! No commitments. Pay as you go.

Santiago

261,311 Aufrufe • vor 1 Jahr

Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers. Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels! Blog: ggml kernels:

Millions of GGUF downloads later, those same llama.cpp checkpoints can now run in 🤗 transformers. Same models, more ways to use them, and fast local inference on Mac powered by ggml kernels! Blog: ggml kernels:

Marc Sun

66,530 Aufrufe • vor 1 Monat

I ported Vercel's fx coding agent to Windows 98 it talks to an LLM over a 56k modem and supports computer use (via MCP.exe) I now proudly run my own gamedev studio from 1999 my agents email each other in Outlook and store code on a network drive (git was not invented yet, sorry) good times

I ported Vercel's fx coding agent to Windows 98 it talks to an LLM over a 56k modem and supports computer use (via MCP.exe) I now proudly run my own gamedev studio from 1999 my agents email each other in Outlook and store code on a network drive (git was not invented yet, sorry) good times

alexey taktarov

31,848 Aufrufe • vor 16 Tagen

Lyapunov proved in 1892 that you never need to solve a differential equation to know if a system will stabilize. Find one function that behaves like energy — positive everywhere, zero at equilibrium — and if it's always decreasing, the system is guaranteed to converge. No solution required. The trick is that real energy often fails the test. A pendulum's kinetic energy hits zero at every moment of stillness, not just at rest — so it can't prove asymptotic stability alone. You need a generalized artificial energy with cross terms mixing position and velocity. The same Lyapunov stability analysis is what ML engineers run on neural network training dynamics to prove gradient descent actually converges instead of oscillating forever on GPU clusters. 16 minutes. Bookmark & watch today.

Lyapunov proved in 1892 that you never need to solve a differential equation to know if a system will stabilize. Find one function that behaves like energy — positive everywhere, zero at equilibrium — and if it's always decreasing, the system is guaranteed to converge. No solution required. The trick is that real energy often fails the test. A pendulum's kinetic energy hits zero at every moment of stillness, not just at rest — so it can't prove asymptotic stability alone. You need a generalized artificial energy with cross terms mixing position and velocity. The same Lyapunov stability analysis is what ML engineers run on neural network training dynamics to prove gradient descent actually converges instead of oscillating forever on GPU clusters. 16 minutes. Bookmark & watch today.

Deliriumm

46,282 Aufrufe • vor 1 Monat

$Announcing the limited alpha release of our GPU marketplace, with $50 in free credits for 100 selected testers—apply now for a chance to participate! 🤘🏼🌪️ Hyperbolic’s GPU marketplace optimizes global GPU infrastructure, aggregating resources from data centers, mining farms, personal machines, and on-prem setups to make GPUs accessible at a fraction of the cost. Apply to gain access:$

Announcing the limited alpha release of our GPU marketplace, with $50 in free credits for 100 selected testers—apply now for a chance to participate! 🤘🏼🌪️ Hyperbolic’s GPU marketplace optimizes global GPU infrastructure, aggregating resources from data centers, mining farms, personal machines, and on-prem setups to make GPUs accessible at a fraction of the cost. Apply to gain access:

Hyperbolic

26,234 Aufrufe • vor 2 Jahren

THE MS-A2 IS THE MINISFORUM BOX HERMES AGENT WAS NEVER MEANT TO RUN ON, AND THAT'S BY DESIGN The MS-S1 MAX earns its spot running Hermes Agent because of one thing. 128GB of unified memory, up to 96GB of it handed straight to the GPU. That's the only reason a 120B model fits and runs locally for $0 a month The MS-A2 solves a different problem. Ryzen 9 9955HX, 16 cores, 32 threads, up to 96GB of regular DDR5-5600, no unified pool Three M.2 PCIe 4.0 slots, one U.2, two 22110. Dual 10Gbps SFP+ LAN plus 2.5G. WiFi 6E. Bluetooth 5.3. A slide-out motherboard for fast upgrades. A real PCIe x16 slot that actually takes a low-profile GPU That last part is where the two machines split for good. The MS-S1 MAX's PCIe slot won't take a GPU at all, every bit of GPU power has to come from the unified chip itself. The MS-A2 trades that unified memory trick for raw expandability instead One box runs a local AI agent. The other runs a home lab that needs storage, networking, and room to grow. Minisforum built both on purpose, not as the same product wearing two names

NO1ennn

25,645 Aufrufe • vor 4 Monaten