Loading video...

Video Failed to Load

Go Home

📣 MLPerf Inference v6.0 results are in. Learn how systems powered by NVIDIA Blackwell set the pace on inference, delivering the highest AI factory throughput. 🔗

NVIDIAAIInfra's profile picture

NVIDIA AI Infrastructure

70,175 subscribers

34,071 views • 4 months ago •via X (Twitter)

News & PoliticsScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Delivered performance, not peak chip specifications, drives AI factory productivity. Rigorous benchmarks are the only way to see past the noise. In MLPerf Inference v6.0, NVIDIA extreme co-design delivered the highest token output across the broadest range of models and scenarios. Maximizing token output drives down token cost and maximizes AI factory productivity. Read the blog post to dive into the details: Baseten, CoreWeave, MLCommons
0:43

Delivered performance, not peak chip specifications, drives AI factory productivity. Rigorous benchmarks are the only way to see past the noise. In MLPerf Inference v6.0, NVIDIA extreme co-design delivered the highest token output across the broadest range of models and scenarios. Maximizing token output drives down token cost and maximizes AI factory productivity. Read the blog post to dive into the details: Baseten, CoreWeave, MLCommons

NVIDIA

27,483 views • 4 months ago

We are innovating the full-stack AI infrastructure platform on a one-year rhythm — pushing the boundaries of inference performance across chips, systems, and software. NVIDIA Blackwell is the most advanced AI platform ever built — continuously optimized for record-breaking performance. Groundbreaking advancements include the NVIDIA-designed NVFP4 format, enabling high inference performance and accuracy. #GTCParis at #VivaTech
1:06

We are innovating the full-stack AI infrastructure platform on a one-year rhythm — pushing the boundaries of inference performance across chips, systems, and software. NVIDIA Blackwell is the most advanced AI platform ever built — continuously optimized for record-breaking performance. Groundbreaking advancements include the NVIDIA-designed NVFP4 format, enabling high inference performance and accuracy. #GTCParis at #VivaTech

NVIDIA

80,625 views • 1 year ago

Introducing the NVIDIA Project DIGITS personal AI supercomputer, powered by the GB10 Grace Blackwell Superchip: Project DIGITS enables developers to prototype, fine-tune and inference models locally and seamlessly deploy at scale to the data center or cloud. #CES2025 #NVIDIAGraceBlackwell
0:23

Introducing the NVIDIA Project DIGITS personal AI supercomputer, powered by the GB10 Grace Blackwell Superchip: Project DIGITS enables developers to prototype, fine-tune and inference models locally and seamlessly deploy at scale to the data center or cloud. #CES2025 #NVIDIAGraceBlackwell

NVIDIA

51,991 views • 1 year ago

The MLPerf results are in! We’re raising the bar with competitive solutions for your high-performance, high-efficiency deep learning inference needs — even on challenging LLMs. Read more about the results. #IntelXeon #IntelGaudi #Intel
0:30

The MLPerf results are in! We’re raising the bar with competitive solutions for your high-performance, high-efficiency deep learning inference needs — even on challenging LLMs. Read more about the results. #IntelXeon #IntelGaudi #Intel

Intel

26,425 views • 2 years ago

The first-ever hydrogen-powered NVIDIA GB300 NVL72 systems are online. Training & inference at scale — with zero emissions, zero water. Lambda × Supermicro × ECL →
0:39

The first-ever hydrogen-powered NVIDIA GB300 NVL72 systems are online. Training & inference at scale — with zero emissions, zero water. Lambda × Supermicro × ECL →

Lambda

17,984 views • 10 months ago

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️
0:45

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

NVIDIA AI

16,053 views • 6 months ago

Discover how we're partnering with Europe to build a future powered by sovereign infrastructure, agentic AI, robotics, and exponential inference. Catch up on all the news unveiled at Jensen Huang's latest keynote at #GTCParis:
0:30

Discover how we're partnering with Europe to build a future powered by sovereign infrastructure, agentic AI, robotics, and exponential inference. Catch up on all the news unveiled at Jensen Huang's latest keynote at #GTCParis:

NVIDIA

39,232 views • 1 year ago

Jensen Huang said Grok 5 will be 7 Trillion parameter model. On time to train, with the training window fixed at 1 month, the new Vera-Rubin GPU system of Nvidia needs 1/4 the number of systems compared with Blackwell to train the same frontier model. “factory throughput” improves by about 10x over Blackwell, and Blackwell itself was about 10x over Hopper. i.e. overall Rubin is roughly 100x Hopper in factory throughput per watt, which matters hugely, because a 1 GW, $50B data center is power-limited and revenue scales with throughput per watt. --- From Nvidia YT channel
1:24

Jensen Huang said Grok 5 will be 7 Trillion parameter model. On time to train, with the training window fixed at 1 month, the new Vera-Rubin GPU system of Nvidia needs 1/4 the number of systems compared with Blackwell to train the same frontier model. “factory throughput” improves by about 10x over Blackwell, and Blackwell itself was about 10x over Hopper. i.e. overall Rubin is roughly 100x Hopper in factory throughput per watt, which matters hugely, because a 1 GW, $50B data center is power-limited and revenue scales with throughput per watt. --- From Nvidia YT channel

Rohan Paul

165,770 views • 7 months ago

Nvidia just revealed Vera Rubin. Ships H2 2026. The numbers are wild: → 10x more performance per watt vs Blackwell → 10x cheaper inference token cost → 4x fewer GPUs to train the same MoE model Energy was the biggest bottleneck in AI. Nvidia just made it 10x cheaper.
0:27

Nvidia just revealed Vera Rubin. Ships H2 2026. The numbers are wild: → 10x more performance per watt vs Blackwell → 10x cheaper inference token cost → 4x fewer GPUs to train the same MoE model Energy was the biggest bottleneck in AI. Nvidia just made it 10x cheaper.

Min Choi

285,155 views • 5 months ago

The NVIDIA Blackwell platform just swept MLPerf Training 6.0, delivering fastest performance and largest scale. Beyond the benchmarks, capabilities like the Reliability, Availability, and Serviceability Engine and NVIDIA Resiliency Extension deliver fewer interruptions and faster recovery to keep massive training jobs on track.
0:45

The NVIDIA Blackwell platform just swept MLPerf Training 6.0, delivering fastest performance and largest scale. Beyond the benchmarks, capabilities like the Reliability, Availability, and Serviceability Engine and NVIDIA Resiliency Extension deliver fewer interruptions and faster recovery to keep massive training jobs on track.

NVIDIA

47,702 views • 1 month ago

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth
0:41

"The inflection point for inference has arrived." — Jensen Huang, Founder & CEO of NVIDIA We’ve officially crossed a new milestone in the inference era — where widespread adoption of AI shifts from learning to doing. The breakthrough: extreme codesign across hardware and software driving down cost per token. Lower cost → more inference More inference → more users and applications More users and applications → exponential AI revenue growth

NVIDIA

81,834 views • 4 months ago

🔥 NVIDIA GTC 2026: The Vera Rubin platform just dropped, introducing 10x inference throughput per watt, at 1/10th the cost per token vs. Blackwell. Jensen Huang called it: every company will now run a "token factory." Here's the thing: Aethir has been running distributed token factories since day one, with nearly 440,000+ GPU containers across 94 countries, delivering 1.5B+ compute hours to enterprises, powered by ATH. When the world's most powerful AI chips land, you need a cloud that can actually deploy them at scale, without the centralized cloud limitations and bottlenecks. That's Aethir’s advantage over centralized compute providers. ⚡
0:36

🔥 NVIDIA GTC 2026: The Vera Rubin platform just dropped, introducing 10x inference throughput per watt, at 1/10th the cost per token vs. Blackwell. Jensen Huang called it: every company will now run a "token factory." Here's the thing: Aethir has been running distributed token factories since day one, with nearly 440,000+ GPU containers across 94 countries, delivering 1.5B+ compute hours to enterprises, powered by ATH. When the world's most powerful AI chips land, you need a cloud that can actually deploy them at scale, without the centralized cloud limitations and bottlenecks. That's Aethir’s advantage over centralized compute providers. ⚡

Aethir Ecosystem

14,682 views • 4 months ago

Energy efficiency in LLM inference has improved 100,000x in the past 10 years — demonstrating that accelerated computing is sustainable computing. Josh Parker, head of sustainability at NVIDIA, explains how. #ClimateWeekNYC Learn more:
1:00

Energy efficiency in LLM inference has improved 100,000x in the past 10 years — demonstrating that accelerated computing is sustainable computing. Josh Parker, head of sustainability at NVIDIA, explains how. #ClimateWeekNYC Learn more:

NVIDIA

32,252 views • 10 months ago

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering
27:58

What is AI inference engineering, why is it such an in-demand skill, and how do you break into the field? With author of Inference Engineering Philip Kiely and head of training at Baseten Charlie O'Neill 0:00: What is inference? 2:47: History of inference 4:59: Downstream effects of AI research on inference 13:54: What you'll learn from Inference Engineering 16:14: Advice for engineers transitioning into AI 19:00: Open source models driving inference growth 20:55: Specialization vs. frontier closed models 23:51: "Big Token" and the importance of open source AI 27:18: Where to get Inference Engineering

Madison Kanna

119,268 views • 4 months ago

📣 CoreWeave and NVIDIA are accelerating the build out of AI factories—token generators that directly drive revenue. This includes adoption of and support for: ✅ NVIDIA Vera Rubin deployment, starting in 2H 2026 ✅ NVIDIA Vera CPU and BlueField-4 STX ✅ NVIDIA Dynamo for inference and NVIDIA Agent Toolkit and OpenShell for long-running agents ✅ NVIDIA DSX Air for digital twins of AI factories Learn more ➡️
0:23

📣 CoreWeave and NVIDIA are accelerating the build out of AI factories—token generators that directly drive revenue. This includes adoption of and support for: ✅ NVIDIA Vera Rubin deployment, starting in 2H 2026 ✅ NVIDIA Vera CPU and BlueField-4 STX ✅ NVIDIA Dynamo for inference and NVIDIA Agent Toolkit and OpenShell for long-running agents ✅ NVIDIA DSX Air for digital twins of AI factories Learn more ➡️

NVIDIA AI Infrastructure

10,213 views • 3 months ago

sam.cpp 👀 Inference of Meta's Segment Anything Model on the CPU Project by Yavor Ivanov - powered by
1:05

sam.cpp 👀 Inference of Meta's Segment Anything Model on the CPU Project by Yavor Ivanov - powered by

Georgi Gerganov

264,652 views • 2 years ago

Unbiased AI -- at Scale Truly Open, inference at scale, running on Subnet 4. Powered by the Bittensor ecosystem. Full episode on Youtube and Spotify:
0:57

Unbiased AI -- at Scale Truly Open, inference at scale, running on Subnet 4. Powered by the Bittensor ecosystem. Full episode on Youtube and Spotify:

Openτensor Foundaτion

45,393 views • 1 year ago

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:
0:53

⚡️Today marks a big milestone for Nebius. We’re launching Nebius Token Factory, the evolution of Nebius AI Studio, built to make open-source AI production-grade. Token Factory transforms raw open models into governed, scalable systems with dedicated inference, sub-second latency, 99.9% uptime and zero-retention compliance. It’s where inference, post-training and governance converge, turning raw compute into reliable intelligence. Run AI inference at scale:

Nebius Token Factory

260,215 views • 9 months ago

Introducing GeForce RTX 50 Series graphics cards & laptops. Powered by NVIDIA Blackwell architecture & AI, the RTX 50 Series enables new experiences & next-level graphics fidelity. Learn More →
1:00

Introducing GeForce RTX 50 Series graphics cards & laptops. Powered by NVIDIA Blackwell architecture & AI, the RTX 50 Series enables new experiences & next-level graphics fidelity. Learn More →

NVIDIA GeForce

1,028,894 views • 1 year ago