Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

.Reiner Pope explains the difference between a CPU and a GPU. A huge chunk of a CPU die is actually just predicting what code will run next. GPUs strip this out, which is part of why they can fit so much more compute on the chip.

Dwarkesh Patel

239,391 subscribers

62,507 görüntüleme • 1 ay önce •via X (Twitter)

Eğitim Bilim & Teknoloji

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Breaking down the difference between CPU and GPU. This is such a joy to watch.

Breaking down the difference between CPU and GPU. This is such a joy to watch.

Barsee 🐶

55,020 görüntüleme • 1 yıl önce

Incoming: The Big Ole Chip Flip CPUs > GPUs COATUE CIO of Public Investments Jaimin Rangwalla says AI agents could fundamentally reshape compute demand: “Historically CPUs have done something called serial processing, which is like you just give it a set of instructions and it does one by one by one by one. It was very much a 1 CPU : 8 GPUs. It had gone up to 1 CPU : 16 GPUs, which was all of the math & all of the computation happening at the GPUs. But now the ratio is actually moving from 1 CPU : 4 GPUs."

Incoming: The Big Ole Chip Flip CPUs > GPUs COATUE CIO of Public Investments Jaimin Rangwalla says AI agents could fundamentally reshape compute demand: “Historically CPUs have done something called serial processing, which is like you just give it a set of instructions and it does one by one by one by one. It was very much a 1 CPU : 8 GPUs. It had gone up to 1 CPU : 16 GPUs, which was all of the math & all of the computation happening at the GPUs. But now the ratio is actually moving from 1 CPU : 4 GPUs."

Molly O’Shea

15,390 görüntüleme • 1 ay önce

"The GPU has a lot of tiny, tiny TPUs tiled across the whole chip." Reiner Pope on the architectural difference between the two dominant AI chip designs.

"The GPU has a lot of tiny, tiny TPUs tiled across the whole chip." Reiner Pope on the architectural difference between the two dominant AI chip designs.

Dwarkesh Patel

79,018 görüntüleme • 1 ay önce

Billions of times a second, all the circuitry on an AI chip pauses, just for a moment. Why? Reiner Pope explained to me what's going on, and what the clock cycle of a chip is actually telling us:

Billions of times a second, all the circuitry on an AI chip pauses, just for a moment. Why? Reiner Pope explained to me what's going on, and what the clock cycle of a chip is actually telling us:

Dwarkesh Patel

28,938 görüntüleme • 1 ay önce

This perfectly shows the difference between CPU and GPU 💨

This perfectly shows the difference between CPU and GPU 💨

F.O.L.A

38,826 görüntüleme • 6 ay önce

What is a DPU, NPU, GPU vs CPU? And why are they in Cisco switches? #Sponsored #Cisco #dpu #CPU #npu #GPU #switch #CiscoLiveEMEA Cisco Live EMEA Cisco

What is a DPU, NPU, GPU vs CPU? And why are they in Cisco switches? #Sponsored #Cisco #dpu #CPU #npu #GPU #switch #CiscoLiveEMEA Cisco Live EMEA Cisco

David Bombal

14,665 görüntüleme • 1 yıl önce

Power difference between CPU and GPU

Power difference between CPU and GPU

D4rsh🦅

178,593 görüntüleme • 11 ay önce

Every year I use ZERO "Run plays" for the CPU in #NBA2K26 and a lot of people ask why. People think it causes the CPU to never run plays, but as you can see if you can balance the individual player tendencies correctly the result is a smooth authentic CPU offensive experience.

Every year I use ZERO "Run plays" for the CPU in #NBA2K26 and a lot of people ask why. People think it causes the CPU to never run plays, but as you can see if you can balance the individual player tendencies correctly the result is a smooth authentic CPU offensive experience.

Shady 🧊

184,692 görüntüleme • 4 ay önce

Microsoft sold every spare CPU it had to Anthropic and OpenAI. Amazon tripled its CPU buys year over year and still can't keep up. Two of AWS's biggest customers asked Andy Jassy if they could buy the entire 2026 production run of Graviton chips. He said no. The ratio inside an AI datacenter used to be 100 megawatts of GPUs to 1 megawatt of CPUs. CPUs handled storage, checkpointing, pre-processing. Light work. GPUs did the actual training and inference. Then OpenAI shipped o1-preview in September 2024. RL post-training went from "check the model output with a regex" to "run classifiers" to "compile the code and run the unit tests" to "spin up a sandbox, call three databases, run a physics simulation, verify the answer." Every rollout now needs a CPU-backed environment to verify against. Codex 5.4 runs agentically for 6-7 hours at a time. Each database call, each cron job, each scraped URL is CPU work. Coding agent revenue went from a couple billion to north of $10B in six months. That compute is sitting on CPUs. The CPU to GPU ratio is now approaching 1:1. The entire global cloud was built for 1:8. That's why GitHub has been unstable for weeks. Nvidia and Arm both announced they're entering the server CPU market in March. TSMC will only meet 80% of server CPU wafer demand this year. High-end server CPU prices are already up 50%. When the GPU king and the IP licensor both pivot to CPUs in the same month, the boring chip isn't boring anymore.

Microsoft sold every spare CPU it had to Anthropic and OpenAI. Amazon tripled its CPU buys year over year and still can't keep up. Two of AWS's biggest customers asked Andy Jassy if they could buy the entire 2026 production run of Graviton chips. He said no. The ratio inside an AI datacenter used to be 100 megawatts of GPUs to 1 megawatt of CPUs. CPUs handled storage, checkpointing, pre-processing. Light work. GPUs did the actual training and inference. Then OpenAI shipped o1-preview in September 2024. RL post-training went from "check the model output with a regex" to "run classifiers" to "compile the code and run the unit tests" to "spin up a sandbox, call three databases, run a physics simulation, verify the answer." Every rollout now needs a CPU-backed environment to verify against. Codex 5.4 runs agentically for 6-7 hours at a time. Each database call, each cron job, each scraped URL is CPU work. Coding agent revenue went from a couple billion to north of $10B in six months. That compute is sitting on CPUs. The CPU to GPU ratio is now approaching 1:1. The entire global cloud was built for 1:8. That's why GitHub has been unstable for weeks. Nvidia and Arm both announced they're entering the server CPU market in March. TSMC will only meet 80% of server CPU wafer demand this year. High-end server CPU prices are already up 50%. When the GPU king and the IP licensor both pivot to CPUs in the same month, the boring chip isn't boring anymore.

Aakash Gupta

290,560 görüntüleme • 2 ay önce

What’s the difference between GPU, CPU, NPU, & TPU?

What’s the difference between GPU, CPU, NPU, & TPU?

Emma Steuer 🧚🤖

19,332 görüntüleme • 4 ay önce

$AMD will become a multi-trillion dollar company. The AI boom is no longer just about GPUs. In early AI data centers, the CPU-to-GPU ratio was around 1:8. Now it’s moving closer to 1:1 because agentic AI requires dramatically more CPU compute. Lisa Su: “Based on the demand signals we are seeing today and the structural increase in CPU compute requirements driven by agentic AI, we now expect the server CPU TAM to grow at greater than 35% annually, reaching over $120 billion by 2030.” Add to that the 6GW AI infrastructure deals with $META and OpenAI, plus deep collaboration on multiple future chip generations, and it becomes clear why $AMD is positioned to compound for years. I’m not chasing $AMD here after a +110% move in just over a month. But the long-term story remains intact.

$AMD will become a multi-trillion dollar company. The AI boom is no longer just about GPUs. In early AI data centers, the CPU-to-GPU ratio was around 1:8. Now it’s moving closer to 1:1 because agentic AI requires dramatically more CPU compute. Lisa Su: “Based on the demand signals we are seeing today and the structural increase in CPU compute requirements driven by agentic AI, we now expect the server CPU TAM to grow at greater than 35% annually, reaching over $120 billion by 2030.” Add to that the 6GW AI infrastructure deals with $META and OpenAI, plus deep collaboration on multiple future chip generations, and it becomes clear why $AMD is positioned to compound for years. I’m not chasing $AMD here after a +110% move in just over a month. But the long-term story remains intact.

Daniel

39,585 görüntüleme • 2 ay önce

Dylan Patel, founder of SemiAnalysis, on why GitHub keeps breaking: "The entire cloud market ran out of CPUs. Microsoft sold all their spare ones to Anthropic and OpenAI. They have none left." That GitHub instability you keep hitting isn't a bug. It's the AI labs eating the world's compute. One customer ran a million CPU jobs in six hours. Amazon tripled CPU server installs year on year and still ran dry. Everyone watches the GPU race. The thing that actually broke was the boring chip nobody was looking at.

Dylan Patel, founder of SemiAnalysis, on why GitHub keeps breaking: "The entire cloud market ran out of CPUs. Microsoft sold all their spare ones to Anthropic and OpenAI. They have none left." That GitHub instability you keep hitting isn't a bug. It's the AI labs eating the world's compute. One customer ran a million CPU jobs in six hours. Amazon tripled CPU server installs year on year and still ran dry. Everyone watches the GPU race. The thing that actually broke was the boring chip nobody was looking at.

zostaff

82,561 görüntüleme • 24 gün önce

Stress testing Metropolis 1998! - Population: 53,500 - CPU FPS: 80 - GPU FPS: 10-80 - RAM: 3,100 MB So: At the moment, the game is GPU bound. I know why and there's a lot of room for improvement. It will involve developing or customizing an existing GPU framework. There's also a lot of room to improve CPU/RAM, but right now it's in an okay place. #gamedev

Stress testing Metropolis 1998! - Population: 53,500 - CPU FPS: 80 - GPU FPS: 10-80 - RAM: 3,100 MB So: At the moment, the game is GPU bound. I know why and there's a lot of room for improvement. It will involve developing or customizing an existing GPU framework. There's also a lot of room to improve CPU/RAM, but right now it's in an okay place. #gamedev

Yesbox - Metropolis 1998

84,873 görüntüleme • 1 yıl önce

Most C Programmers don't have a clue as to how the CPU works. Here is a lecture from my course on the C Language that introduces how to visualise the CPU as a C (or general software) Programmer.... More Details are at: Being able to model the behaviour of CPU provides a solid base to reason about your code. The summary is - - The CPU is a state machine which maintains it's states in registers. - It has busses to memory for requesting data/instruction read/writes. - Interrupts to attend to events. I discuss this and more in my course on the C Language.

Most C Programmers don't have a clue as to how the CPU works. Here is a lecture from my course on the C Language that introduces how to visualise the CPU as a C (or general software) Programmer.... More Details are at: Being able to model the behaviour of CPU provides a solid base to reason about your code. The summary is - - The CPU is a state machine which maintains it's states in registers. - It has busses to memory for requesting data/instruction read/writes. - Interrupts to attend to events. I discuss this and more in my course on the C Language.

Piyush Itankar

28,019 görüntüleme • 1 yıl önce

ELON: TESLA'S AI5 CHIP IS THE SILICON VERSION OF “LESS IS MORE” "The AI5 chip will be 40 times better than the AI4 chip – not 40%, 40 times. We have a detailed understanding of the entire software and hardware stack. We are designing the hardware to address all of the pain points in software. We know what the chip needs to do, and we know, just as importantly, what the chip doesn’t need to do. A long list of deletions that are very important. As a result of these deletions, we can actually fit AI5 in a half reticle with a good margin for the traces from the memory to the Tesla chip accelerators, the ARM CPU cores, and the PCI blocks. This is a beautiful chip." Source: Elon Musk, Tesla Podcast, October 22, 2025

ELON: TESLA'S AI5 CHIP IS THE SILICON VERSION OF “LESS IS MORE” "The AI5 chip will be 40 times better than the AI4 chip – not 40%, 40 times. We have a detailed understanding of the entire software and hardware stack. We are designing the hardware to address all of the pain points in software. We know what the chip needs to do, and we know, just as importantly, what the chip doesn’t need to do. A long list of deletions that are very important. As a result of these deletions, we can actually fit AI5 in a half reticle with a good margin for the traces from the memory to the Tesla chip accelerators, the ARM CPU cores, and the PCI blocks. This is a beautiful chip." Source: Elon Musk, Tesla Podcast, October 22, 2025

Mario Nawfal

363,459 görüntüleme • 8 ay önce

NVIDIA CEO Jensen Huang announces the GB10 superchip GPU+CPU package for use with workstations packing 1 petaFLOPS of compute and a 4TB SSD

NVIDIA CEO Jensen Huang announces the GB10 superchip GPU+CPU package for use with workstations packing 1 petaFLOPS of compute and a 4TB SSD

Tsarathustra

131,573 görüntüleme • 1 yıl önce

CEO Rene Haas on why AI agents are spiking CPU demand: ▫️use >15x more tokens than humans ▫️a 1GW data centres now need 4x CPU cores (120m vs. 30m) for the AI agents AI agents are doing general asynchronous tasks (browse, spreadsheets) that are best-suited CPUs. So, 4x more CPUs per 1GW of GPUs…but the data centre’s power envelope is the same. Need energy-efficient CPU solutions, which is right down Arm’s lane of expertise (its ubiquitous mobile chips win on energy efficiency)….hence ARM’s recent AI CPU announcement.

CEO Rene Haas on why AI agents are spiking CPU demand: ▫️use >15x more tokens than humans ▫️a 1GW data centres now need 4x CPU cores (120m vs. 30m) for the AI agents AI agents are doing general asynchronous tasks (browse, spreadsheets) that are best-suited CPUs. So, 4x more CPUs per 1GW of GPUs…but the data centre’s power envelope is the same. Need energy-efficient CPU solutions, which is right down Arm’s lane of expertise (its ubiquitous mobile chips win on energy efficiency)….hence ARM’s recent AI CPU announcement.

Bearly AI

129,780 görüntüleme • 2 ay önce

"Agentic AI changes the role of the CPU. The CPU is now the conductor and the GPU is the orchestra". 🎼 NVIDIA Vera is the first CPU built for AI agents — purpose-built from the ground up for how AI works today. Faster. More efficient. Ready for what's next. 🔲 #NVIDIAGTC

"Agentic AI changes the role of the CPU. The CPU is now the conductor and the GPU is the orchestra". 🎼 NVIDIA Vera is the first CPU built for AI agents — purpose-built from the ground up for how AI works today. Faster. More efficient. Ready for what's next. 🔲 #NVIDIAGTC

NVIDIA AI Infrastructure

15,062 görüntüleme • 1 ay önce

.Beff (e/acc) explains how thermodynamic computing fits into the current computing stack: "We don't do GPUs. They're called TSUs, thermodynamic sampling units. We think people are gonna put them next to GPUs or whatever their favorite accelerator is." "You don't need to run the whole workload on the TSU, but it could run certain parts of the workload, just like the GPU is complementary to the CPU initially." "The TSU is gonna help give you more performance per watt in your data center when combined with existing build-outs." "Let's say you're serving a large diffusion model. What we showed is that by using a TSU, you can use something called an energy-based model instead of a simple probabilistic kernel." "Overall you can have basically 100 times the performance per watt of just running on pure GPUs because our chips are much lower wattage."

.Beff (e/acc) explains how thermodynamic computing fits into the current computing stack: "We don't do GPUs. They're called TSUs, thermodynamic sampling units. We think people are gonna put them next to GPUs or whatever their favorite accelerator is." "You don't need to run the whole workload on the TSU, but it could run certain parts of the workload, just like the GPU is complementary to the CPU initially." "The TSU is gonna help give you more performance per watt in your data center when combined with existing build-outs." "Let's say you're serving a large diffusion model. What we showed is that by using a TSU, you can use something called an energy-based model instead of a simple probabilistic kernel." "Overall you can have basically 100 times the performance per watt of just running on pure GPUs because our chips are much lower wattage."

MTS

42,570 görüntüleme • 1 ay önce