Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Quantum's CUDA moment is NOW. CUDA made GPUs accessible outside gaming. We're doing the same for QPUs. Learn more: Colton Dillion's full Quantum Tech World talk, linked in reply ↓

Quip Network

129,461 subscribers

78,550 Aufrufe • vor 1 Monat •via X (Twitter)

Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Quantum computing will be a trillion dollar industry before 2050. We are still early. Check out Colton Dillion's full Quantum Tech World presentation on our YouTube - linked in reply ↓

Quantum computing will be a trillion dollar industry before 2050. We are still early. Check out Colton Dillion's full Quantum Tech World presentation on our YouTube - linked in reply ↓

Quip Network

38,803 Aufrufe • vor 1 Monat

You shouldn't need a PhD to use quantum. Just like you don't need to understand how GPUs work to use AI. Full Colton Dillion presentation from Quantum Tech World, linked in reply - no PhD required.

You shouldn't need a PhD to use quantum. Just like you don't need to understand how GPUs work to use AI. Full Colton Dillion presentation from Quantum Tech World, linked in reply - no PhD required.

Quip Network

43,487 Aufrufe • vor 1 Monat

🎉 "This is the 20th anniversary of CUDA. We have been working on this architecture for 20 years ... to now have built up hundreds of millions of GPUs and computing systems around the world that run CUDA."

🎉 "This is the 20th anniversary of CUDA. We have been working on this architecture for 20 years ... to now have built up hundreds of millions of GPUs and computing systems around the world that run CUDA."

NVIDIA HPC Developer

28,071 Aufrufe • vor 6 Monaten

YOUR PARENTS PAID FOR THE CUDA MOAT! The #1 contributor to the CUDA MOAT isn't the the developers at NVIDIA, but it is the millions of developers outside of NVIDIA that invent new algorithms for CUDA like Flash Attention. For most of them, it started with an GeForce gaming GPU. NVIDIA is the only companies that has an reasonable good developer stack on consumer grade GPUs. As people grow up beyond playing CSGO & League of Legends & Minecraft, they either become anime weeaboos or they start programming on their existing computer with has an GeForce GPU

YOUR PARENTS PAID FOR THE CUDA MOAT! The #1 contributor to the CUDA MOAT isn't the the developers at NVIDIA, but it is the millions of developers outside of NVIDIA that invent new algorithms for CUDA like Flash Attention. For most of them, it started with an GeForce gaming GPU. NVIDIA is the only companies that has an reasonable good developer stack on consumer grade GPUs. As people grow up beyond playing CSGO & League of Legends & Minecraft, they either become anime weeaboos or they start programming on their existing computer with has an GeForce GPU

SemiAnalysis

25,230 Aufrufe • vor 5 Monaten

I sat down with NVIDIA Sam Stanwyck (Sam Stanwyck) at ISC to talk about one of the most misunderstood areas in computing: quantum. We discussed why NVIDIA is not building a quantum computer, but instead the infrastructure around it: GPUs, AI, CUDA-Q, quantum simulation, control systems, error correction, and the path toward hybrid CPU/GPU/QPU supercomputing. The key takeaway: Quantum will likely not arrive as a standalone magic machine. It will arrive as part of a much larger accelerated computing stack, combining classical supercomputers, AI, GPUs, and quantum processors to tackle problems in chemistry, materials science, energy, optimization, and fundamental science. Full episode with Sam Stanwyck is now live.

I sat down with NVIDIA Sam Stanwyck (Sam Stanwyck) at ISC to talk about one of the most misunderstood areas in computing: quantum. We discussed why NVIDIA is not building a quantum computer, but instead the infrastructure around it: GPUs, AI, CUDA-Q, quantum simulation, control systems, error correction, and the path toward hybrid CPU/GPU/QPU supercomputing. The key takeaway: Quantum will likely not arrive as a standalone magic machine. It will arrive as part of a much larger accelerated computing stack, combining classical supercomputers, AI, GPUs, and quantum processors to tackle problems in chemistry, materials science, energy, optimization, and fundamental science. Full episode with Sam Stanwyck is now live.

Chubby♨️

22,673 Aufrufe • vor 2 Monaten

The latest MLX has a CUDA back-end! To get started: pip install "mlx[cuda]" With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs. MLX is designed around Apple silicon - which has a unified memory architecture. It uses the same design with CUDA. So there's no need to move arrays around from CPU memory to GPU memory. Note, this is early days - some operations are missing and performance is still being optimized. But it's already quite fast for Transformer training, text generation, and more! Here's a demo using mlx-lm to generate text with Llama 3 8B (bf16) on an A100:

The latest MLX has a CUDA back-end! To get started: pip install "mlx[cuda]" With the same codebase you can develop locally, run your model on Apple silicon, or in the cloud on Nvidia GPUs. MLX is designed around Apple silicon - which has a unified memory architecture. It uses the same design with CUDA. So there's no need to move arrays around from CPU memory to GPU memory. Note, this is early days - some operations are missing and performance is still being optimized. But it's already quite fast for Transformer training, text generation, and more! Here's a demo using mlx-lm to generate text with Llama 3 8B (bf16) on an A100:

Awni Hannun

42,810 Aufrufe • vor 1 Jahr

Today is World Quantum Day! A great reminder that quantum's impact on cryptography isn't theoretical, it's only a matter of time. To mark the occasion, CEO StaciW_DC sat down with world-renowned post-quantum cryptographer and Algorand CSO Chris Peikert to discuss the quantum threat to blockchain. Since 2022, Algorand has been leading in blockchain quantum resilience by securing its entire chain history with Falcon-signed State Proofs. In 2025, we took it further: the first quantum-resistant transaction protecting real digital assets was executed on mainnet. With Google now targeting 2029 for its own post-quantum migration, the urgency is clear. Algorand isn't waiting, we're already building for that future. Watch now! 👇

Today is World Quantum Day! A great reminder that quantum's impact on cryptography isn't theoretical, it's only a matter of time. To mark the occasion, CEO StaciW_DC sat down with world-renowned post-quantum cryptographer and Algorand CSO Chris Peikert to discuss the quantum threat to blockchain. Since 2022, Algorand has been leading in blockchain quantum resilience by securing its entire chain history with Falcon-signed State Proofs. In 2025, we took it further: the first quantum-resistant transaction protecting real digital assets was executed on mainnet. With Google now targeting 2029 for its own post-quantum migration, the urgency is clear. Algorand isn't waiting, we're already building for that future. Watch now! 👇

Algorand Foundation

64,547 Aufrufe • vor 5 Monaten

Ben Thompson explains how LLMs greatly diminished Nvidia's CUDA moat even as they sent the stock to the moon "So the weird thing about large language models is they were obviously incredible for Nvidia. That's why their stock went to the moon." "They have been on and off the most valuable company in the world." "It was also very bad for Nvidia. And the reason it was bad for Nvidia is that the play with CUDA is to build a developer ecosystem on top of CUDA." "But CUDA only works on Nvidia GPUs. So you get CUDA for free. It's easier to use, and it's a tremendous investment. Nvidia almost went under trying to build CUDA at a time when no one understood what they were doing or why they were wasting money on it." "And that's why Jensen Huang will get bristly, particularly when people question their rent-seeking or profit, whatever. It's like, no, they earned their spot fair and square." "Absolutely. It shouldn't be forgotten. They have earned every dollar they've gotten through 25 years of taking massive risks." "It bottomed out in October 2022. I wrote an article like three weeks before ChatGPT came out, tracing their bottoming-out history and their search for what was next." "'Nvidia in the Valley.' So, go back to this GTC. So I wrote an article at the time called 'Nvidia Waves and Moats'." "And what was interesting about that GTC was, number one, it was very boring. All the cool stuff kind of got scrubbed out." "Now, Jensen Huang has brought that stuff back, so the last few GTCs he's more talking about other things. Now it comes across as, oh, you're still looking for something beyond the LLM." "Because the problem with the LLM is it shifts the developer platform far above where Nvidia sits. All the activity is happening on top of LLMs. And so no one who's writing an AI application today is using CUDA." "Now, some people are, if you're training your own model and you're doing some low-level things or non-LLM things." "But the vast majority of the energy and all the money and the ecosystem is far removed from CUDA." "They have no idea and don't need to know or care what chips their application is running on. They're just on the OpenAI API, or the Anthropic API, or using Bedrock on Amazon, and it's sitting on Trainium, and they're using a Chinese open-source model. It's totally abstracted away, and this is why LLMs were bad for Nvidia." "Now, again, all the money they made along the way is worth it, but their moat has been tremendously diminished." "CUDA is still a moat if you need to do stuff that requires CUDA. But the vast majority of stuff, in energy, doesn't require CUDA, like in a post-LLM world."

Ben Thompson explains how LLMs greatly diminished Nvidia's CUDA moat even as they sent the stock to the moon "So the weird thing about large language models is they were obviously incredible for Nvidia. That's why their stock went to the moon." "They have been on and off the most valuable company in the world." "It was also very bad for Nvidia. And the reason it was bad for Nvidia is that the play with CUDA is to build a developer ecosystem on top of CUDA." "But CUDA only works on Nvidia GPUs. So you get CUDA for free. It's easier to use, and it's a tremendous investment. Nvidia almost went under trying to build CUDA at a time when no one understood what they were doing or why they were wasting money on it." "And that's why Jensen Huang will get bristly, particularly when people question their rent-seeking or profit, whatever. It's like, no, they earned their spot fair and square." "Absolutely. It shouldn't be forgotten. They have earned every dollar they've gotten through 25 years of taking massive risks." "It bottomed out in October 2022. I wrote an article like three weeks before ChatGPT came out, tracing their bottoming-out history and their search for what was next." "'Nvidia in the Valley.' So, go back to this GTC. So I wrote an article at the time called 'Nvidia Waves and Moats'." "And what was interesting about that GTC was, number one, it was very boring. All the cool stuff kind of got scrubbed out." "Now, Jensen Huang has brought that stuff back, so the last few GTCs he's more talking about other things. Now it comes across as, oh, you're still looking for something beyond the LLM." "Because the problem with the LLM is it shifts the developer platform far above where Nvidia sits. All the activity is happening on top of LLMs. And so no one who's writing an AI application today is using CUDA." "Now, some people are, if you're training your own model and you're doing some low-level things or non-LLM things." "But the vast majority of the energy and all the money and the ecosystem is far removed from CUDA." "They have no idea and don't need to know or care what chips their application is running on. They're just on the OpenAI API, or the Anthropic API, or using Bedrock on Amazon, and it's sitting on Trainium, and they're using a Chinese open-source model. It's totally abstracted away, and this is why LLMs were bad for Nvidia." "Now, again, all the money they made along the way is worth it, but their moat has been tremendously diminished." "CUDA is still a moat if you need to do stuff that requires CUDA. But the vast majority of stuff, in energy, doesn't require CUDA, like in a post-LLM world."

Fireside Alpha

12,980 Aufrufe • vor 22 Tagen

I trained a 12M parameter LLM on my own ML framework using a Rust backend and CUDA kernels for flash attention, AdamW, and more. Wrote the full transformer architecture, and BPE tokenizer from scratch. The framework features: - Custom CUDA kernels (Flash Attention, fused LayerNorm, fused GELU) for 3x increased throughput - Automatic WebGPU fallback for non-NVIDIA devices - TypeScript API with Rust compute backend - One npm install to get started, prebuilt binaries for every platform Try out the model for yourself: Built with Reese Chong. Check out the repos and blog if you want to learn more. Shoutout to Modal for the compute credits allowing me to train on 2 A100 GPUs without going broke cc sunny madra Gavin

I trained a 12M parameter LLM on my own ML framework using a Rust backend and CUDA kernels for flash attention, AdamW, and more. Wrote the full transformer architecture, and BPE tokenizer from scratch. The framework features: - Custom CUDA kernels (Flash Attention, fused LayerNorm, fused GELU) for 3x increased throughput - Automatic WebGPU fallback for non-NVIDIA devices - TypeScript API with Rust compute backend - One npm install to get started, prebuilt binaries for every platform Try out the model for yourself: Built with Reese Chong. Check out the repos and blog if you want to learn more. Shoutout to Modal for the compute credits allowing me to train on 2 A100 GPUs without going broke cc sunny madra Gavin

Aadi Kulshrestha

820,861 Aufrufe • vor 4 Monaten

We're thrilled to announce that Portuma has been shortlisted for the Smarties Awards, organized by MMA TÜRKİYE 🎉 We've made it to the finals in: 🔥 Gaming, Gamification & E-Sports 🔗 O2O / New Retail & Innovative Tech Sales Channels Stay tuned as we move closer to the big moment! 💪 #Portuma #SmartiesAwards #Innovation #Gaming #Tech

We're thrilled to announce that Portuma has been shortlisted for the Smarties Awards, organized by MMA TÜRKİYE 🎉 We've made it to the finals in: 🔥 Gaming, Gamification & E-Sports 🔗 O2O / New Retail & Innovative Tech Sales Channels Stay tuned as we move closer to the big moment! 💪 #Portuma #SmartiesAwards #Innovation #Gaming #Tech

Portuma

12,567 Aufrufe • vor 1 Jahr

more baby jiung from his days in the english academy, but now doing a grease parody 😭🤏 🔗 the full video is linked in the replies!

more baby jiung from his days in the english academy, but now doing a grease parody 😭🤏 🔗 the full video is linked in the replies!

🐭ྀི

38,819 Aufrufe • vor 4 Monaten

Modal engineer who teaches Full-Stack Deep Learning explained everything an AI engineer needs to know about GPUs in 20 minutes - better than $800 CUDA workshops. memory bandwidth -> SM occupancy -> kernel fusion -> arithmetic intensity -> know when you're compute-bound vs memory-bound. That loop is how you stop overpaying for GPUs you're barely using. VRAM math + roofline model + Modal serverless GPUs + kernel profiling - that's the stack. Watch and save it, then check your own GPU utilization tonight.

Modal engineer who teaches Full-Stack Deep Learning explained everything an AI engineer needs to know about GPUs in 20 minutes - better than $800 CUDA workshops. memory bandwidth -> SM occupancy -> kernel fusion -> arithmetic intensity -> know when you're compute-bound vs memory-bound. That loop is how you stop overpaying for GPUs you're barely using. VRAM math + roofline model + Modal serverless GPUs + kernel profiling - that's the stack. Watch and save it, then check your own GPU utilization tonight.

h100envy

18,442 Aufrufe • vor 2 Monaten

Windsurf CEO explains why traditional startup moats are mostly silly. Varun said even with 50-100 of the best MIT engineers, that's still just "hundreds of engineering years" in your product. Someone else can build something similar in the same space. He used Nvidia as an example. People think CUDA is their real moat, but that's not accurate. Large companies like Google, OpenAI, and Anthropic spend tens of billions on chips. If CUDA didn't exist, they'd find a way to write assembly code and make GPUs work. People use CUDA because Nvidia made it really capable at low floating-point math, great interconnect, and fast computers. Not because they're locked in. Every year Nvidia has pressure - if they don't make hardware, interconnect, and memory bandwidth much faster, their profit margins shrink and AMD will compete. For startups, the only moat is speed. Learning where the dead bodies are. Understanding what doesn't work and building compounding advantages through that knowledge. Speed lets you learn from the market faster, which means you're first to the next idea too.

Windsurf CEO explains why traditional startup moats are mostly silly. Varun said even with 50-100 of the best MIT engineers, that's still just "hundreds of engineering years" in your product. Someone else can build something similar in the same space. He used Nvidia as an example. People think CUDA is their real moat, but that's not accurate. Large companies like Google, OpenAI, and Anthropic spend tens of billions on chips. If CUDA didn't exist, they'd find a way to write assembly code and make GPUs work. People use CUDA because Nvidia made it really capable at low floating-point math, great interconnect, and fast computers. Not because they're locked in. Every year Nvidia has pressure - if they don't make hardware, interconnect, and memory bandwidth much faster, their profit margins shrink and AMD will compete. For startups, the only moat is speed. Learning where the dead bodies are. Understanding what doesn't work and building compounding advantages through that knowledge. Speed lets you learn from the market faster, which means you're first to the next idea too.

Aish

334,732 Aufrufe • vor 1 Jahr

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

Cerebras just had the biggest IPO of the year. Founder Andrew Feldman says the 3 most important things he had to convince investors of while doing the roadshow were that demand for inference is going to 1,000,000x, the GPU isn't the only way to do compute, and that the CUDA moat is overstated. What he said: "Jensen said some time ago on Brad Gerstner's podcast that the demand for inference will grow by a 1,000,000x, and nobody believed him. And at the same time, you saw Sam Altman displaying real vision and going out and trying to lock up huge amounts of compute, memory, data centers, and power, because he saw it too." "[We tried] to share what that means — what exponential demand means. And that we're still so early, and yet the demand for AI compute is overwhelming." "The other thing is that there are lots of ways to do this. The GPU isn't the only way. You've got TPUs, Trainium, and us. There are lots of different ways to build a solution here." "And finally — the notion that CUDA is this grand lock-in is overplayed. Gemini 3, which is an excellent model, was trained on TPUs with no CUDA. The Anthropic models were trained on Trainium with no CUDA. Some of the best models, some of the most interesting things are being done without CUDA. And that lock-in might be overplayed." $CBRS

TBPN

36,474 Aufrufe • vor 4 Monaten

For decades, America's industrial might was forged at the U.S. Steel South Works site in Chicago. Today, steel beams are rising once again at the Illinois Quantum and Microelectronics Park, where PsiQuantum will deploy America's first utility-scale quantum computer. A full-circle moment for South Chicago—forged in steel and made possible by the world-changing promise of quantum technology.

For decades, America's industrial might was forged at the U.S. Steel South Works site in Chicago. Today, steel beams are rising once again at the Illinois Quantum and Microelectronics Park, where PsiQuantum will deploy America's first utility-scale quantum computer. A full-circle moment for South Chicago—forged in steel and made possible by the world-changing promise of quantum technology.

PsiQuantum

54,628 Aufrufe • vor 6 Monaten

DS4 running on DGX Spark (GB10 / CUDA), private branch for now. 12 tokens/sec, the memory bandwidth is limited in this system, at 270GB/sec. But prefill is ways more alighed to M3 Max at ~200 t/s. I'll release when more mature, but it is almost sure that it will get merged.

DS4 running on DGX Spark (GB10 / CUDA), private branch for now. 12 tokens/sec, the memory bandwidth is limited in this system, at 270GB/sec. But prefill is ways more alighed to M3 Max at ~200 t/s. I'll release when more mature, but it is almost sure that it will get merged.

antirez

84,127 Aufrufe • vor 4 Monaten

THIS IS KEY: "It's Time To Realize That We're In An Energy World War!" Learn How The Russia-Ukraine War & The Iran War Are Both Part Of The Same Great Energy World War! 🔴WATCH ALEX JONES LIVE NOW:

THIS IS KEY: "It's Time To Realize That We're In An Energy World War!" Learn How The Russia-Ukraine War & The Iran War Are Both Part Of The Same Great Energy World War! 🔴WATCH ALEX JONES LIVE NOW:

Alex Jones

66,259 Aufrufe • vor 1 Monat

Ubuntu 26.04 LTS, codenamed #ResoluteRaccoon, is now available to download. 🦝 Resolute Raccoon builds on the resilience-focused improvements introduced in interim releases, with TPM-backed full-disk encryption, improved support for application permission prompting, Livepatch updates for Arm-based servers, and Rust-based utilities for enhanced memory safety. This release also brings native support for industry-leading AI/ML toolkits like NVIDIA CUDA and AMD ROCm, making Ubuntu 26.04 LTS the ideal platform for AI development and production workloads. Install now: Learn more about the release:

Ubuntu 26.04 LTS, codenamed #ResoluteRaccoon, is now available to download. 🦝 Resolute Raccoon builds on the resilience-focused improvements introduced in interim releases, with TPM-backed full-disk encryption, improved support for application permission prompting, Livepatch updates for Arm-based servers, and Rust-based utilities for enhanced memory safety. This release also brings native support for industry-leading AI/ML toolkits like NVIDIA CUDA and AMD ROCm, making Ubuntu 26.04 LTS the ideal platform for AI development and production workloads. Install now: Learn more about the release:

Ubuntu

653,887 Aufrufe • vor 4 Monaten