Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

🤝 OpenAI moved Astra's code, optimized for NVIDIA Blackwell, to NVIDIA Vera Rubin, delivering 3x higher throughput out of the box. In just 72 hours, AI optimization unlocked an additional 2x gain. Together, the right hardware and tooling can compress weeks or months of optimization into a single weekend.... show more

NVIDIA AI Infrastructure

83,657 subscribers

36,227 views • 1 month ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

3 Comments

Nyxonx1 month ago

@OpenAI 3x from the hardware, 2x from optimization. 6x throughput. OpenAI lost $20.92 billion running the business in 2025. The real question: does 6x make the bill smaller, or the ambitions bigger?

Web4 News1 month ago

@OpenAI The 3x is expected, new silicon should win.

Lana O'Brien1 month ago

@OpenAI 💚

Related Videos

Sachin Katti says OpenAI had Astra optimize its own inference on NVIDIA's Rubin chip, adding another 2x in 72 hours "It's a testament to NVIDIA's hardware that out of the box we got a 3x improvement in throughput. We literally took the same code that we had optimized for Blackwell, ran it on Rubin, got 3x improvement." "Then, can we actually make Astra run agents using Astra as the base model, go optimize this inference of Astra itself on Rubin? It's a recursive loop. The model is figuring out how to optimize its own inference serving on Rubin chips, and over 72 hours the model produced another 2x improvement on the throughput." "Things that would take weeks, if not months, to optimize in the past, we now are getting models that are very capable of actually producing over a weekend." _______ Link and more from Sachin Katti's conversation:

Sachin Katti says OpenAI had Astra optimize its own inference on NVIDIA's Rubin chip, adding another 2x in 72 hours "It's a testament to NVIDIA's hardware that out of the box we got a 3x improvement in throughput. We literally took the same code that we had optimized for Blackwell, ran it on Rubin, got 3x improvement." "Then, can we actually make Astra run agents using Astra as the base model, go optimize this inference of Astra itself on Rubin? It's a recursive loop. The model is figuring out how to optimize its own inference serving on Rubin chips, and over 72 hours the model produced another 2x improvement on the throughput." "Things that would take weeks, if not months, to optimize in the past, we now are getting models that are very capable of actually producing over a weekend." _______ Link and more from Sachin Katti's conversation:

Fireside Alpha

40,013 views • 1 month ago

Vera Rubin is in full production. We just kicked off the next generation of AI infrastructure with the NVIDIA Rubin platform, bringing together six new chips to deliver one AI supercomputer built for AI at scale. Here are the top 5 things to know 🧵

Vera Rubin is in full production. We just kicked off the next generation of AI infrastructure with the NVIDIA Rubin platform, bringing together six new chips to deliver one AI supercomputer built for AI at scale. Here are the top 5 things to know 🧵

NVIDIA

817,446 views • 9 months ago

Nvidia $NVDA CEO just said that Vera Rubin is now in full production The supply chain Nvidia created for Vera Rubin is twice as large as Grace Blackwell

Nvidia $NVDA CEO just said that Vera Rubin is now in full production The supply chain Nvidia created for Vera Rubin is twice as large as Grace Blackwell

Evan

120,926 views • 4 months ago

📣 CoreWeave and NVIDIA are accelerating the build out of AI factories—token generators that directly drive revenue. This includes adoption of and support for: ✅ NVIDIA Vera Rubin deployment, starting in 2H 2026 ✅ NVIDIA Vera CPU and BlueField-4 STX ✅ NVIDIA Dynamo for inference and NVIDIA Agent Toolkit and OpenShell for long-running agents ✅ NVIDIA DSX Air for digital twins of AI factories Learn more ➡️

📣 CoreWeave and NVIDIA are accelerating the build out of AI factories—token generators that directly drive revenue. This includes adoption of and support for: ✅ NVIDIA Vera Rubin deployment, starting in 2H 2026 ✅ NVIDIA Vera CPU and BlueField-4 STX ✅ NVIDIA Dynamo for inference and NVIDIA Agent Toolkit and OpenShell for long-running agents ✅ NVIDIA DSX Air for digital twins of AI factories Learn more ➡️

NVIDIA AI Infrastructure

10,213 views • 6 months ago

Watch Nvidia CEO Jensen Huang reveal what he described as the state of the art in AI hardware: the new Rubin computing architecture. “Vera Rubin is designed to address this fundamental challenge that we have: The amount of computation necessary for AI is skyrocketing.” Huang said. “Today, I can tell you that Vera Rubin is in full production.” According to Nvidia’s tests, Rubin architecture operates three and a half times faster than the previous Blackwell architecture on model-training tasks and five times faster on inference tasks, and that's just the start.

Watch Nvidia CEO Jensen Huang reveal what he described as the state of the art in AI hardware: the new Rubin computing architecture. “Vera Rubin is designed to address this fundamental challenge that we have: The amount of computation necessary for AI is skyrocketing.” Huang said. “Today, I can tell you that Vera Rubin is in full production.” According to Nvidia’s tests, Rubin architecture operates three and a half times faster than the previous Blackwell architecture on model-training tasks and five times faster on inference tasks, and that's just the start.

TechCrunch

77,035 views • 9 months ago

NVIDIA Vera Rubin is in full production and arrives just in time for the next frontier of AI. The #NVIDIARubin platform uses extreme co-design across six new chips to accelerate agentic AI, advanced reasoning and massive-scale MoE model inference. NVIDIA Vera Rubin NVL72: Six new chips, one AI supercomputer — see how we built it.

NVIDIA Vera Rubin is in full production and arrives just in time for the next frontier of AI. The #NVIDIARubin platform uses extreme co-design across six new chips to accelerate agentic AI, advanced reasoning and massive-scale MoE model inference. NVIDIA Vera Rubin NVL72: Six new chips, one AI supercomputer — see how we built it.

NVIDIA Data Center

27,643 views • 9 months ago

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

NVIDIA AI

16,053 views • 9 months ago

What does it take to build an AI factory ready for the agentic era? 80+ partners joined Jensen Huang at #NVIDIAGTC Taipei to show how NVIDIA MGX is making it possible. With NVIDIA Vera Rubin, 800 VDC, and partners spanning systems, power, and cooling, NVIDIA MGX is turning modular design into deployed AI infrastructure for the agentic AI era. ⚡ #NVIDIAGTC 🔗

What does it take to build an AI factory ready for the agentic era? 80+ partners joined Jensen Huang at #NVIDIAGTC Taipei to show how NVIDIA MGX is making it possible. With NVIDIA Vera Rubin, 800 VDC, and partners spanning systems, power, and cooling, NVIDIA MGX is turning modular design into deployed AI infrastructure for the agentic AI era. ⚡ #NVIDIAGTC 🔗

NVIDIA

145,062 views • 4 months ago

Jensen Huang said Grok 5 will be 7 Trillion parameter model. On time to train, with the training window fixed at 1 month, the new Vera-Rubin GPU system of Nvidia needs 1/4 the number of systems compared with Blackwell to train the same frontier model. “factory throughput” improves by about 10x over Blackwell, and Blackwell itself was about 10x over Hopper. i.e. overall Rubin is roughly 100x Hopper in factory throughput per watt, which matters hugely, because a 1 GW, $50B data center is power-limited and revenue scales with throughput per watt. --- From Nvidia YT channel

Jensen Huang said Grok 5 will be 7 Trillion parameter model. On time to train, with the training window fixed at 1 month, the new Vera-Rubin GPU system of Nvidia needs 1/4 the number of systems compared with Blackwell to train the same frontier model. “factory throughput” improves by about 10x over Blackwell, and Blackwell itself was about 10x over Hopper. i.e. overall Rubin is roughly 100x Hopper in factory throughput per watt, which matters hugely, because a 1 GW, $50B data center is power-limited and revenue scales with throughput per watt. --- From Nvidia YT channel

Rohan Paul

165,770 views • 9 months ago

Nvidia just revealed Vera Rubin. Ships H2 2026. The numbers are wild: → 10x more performance per watt vs Blackwell → 10x cheaper inference token cost → 4x fewer GPUs to train the same MoE model Energy was the biggest bottleneck in AI. Nvidia just made it 10x cheaper.

Nvidia just revealed Vera Rubin. Ships H2 2026. The numbers are wild: → 10x more performance per watt vs Blackwell → 10x cheaper inference token cost → 4x fewer GPUs to train the same MoE model Energy was the biggest bottleneck in AI. Nvidia just made it 10x cheaper.

Min Choi

285,639 views • 8 months ago

AI is becoming a new computing model for media and entertainment. At the 2026 Runway AI Summit, NVIDIA’s Richard Kerris explored how real-time generative AI can make creative production a live, artist-controlled process. Powered by NVIDIA Vera Rubin, Runway brought Gen-4.5 to its platform in one day, helping close the gap between imagining a scene and bringing it to life.

AI is becoming a new computing model for media and entertainment. At the 2026 Runway AI Summit, NVIDIA’s Richard Kerris explored how real-time generative AI can make creative production a live, artist-controlled process. Powered by NVIDIA Vera Rubin, Runway brought Gen-4.5 to its platform in one day, helping close the gap between imagining a scene and bringing it to life.

NVIDIA

209,445 views • 2 months ago

AI that responds in under 100ms doesn't happen by accident. Together AI VP of Kernels Dan Fu shares how they use NVIDIA CUDA, TensorRT-LLM, Dynamo and Together ATLAS on NVIDIA Blackwell to power ultra-low-latency inference and long context code generation for Cursor. From building megakernels that fuse an entire model's forward pass into a single launch to enabling real-time voice agents, Together AI is optimizing latency at every layer of the stack.

AI that responds in under 100ms doesn't happen by accident. Together AI VP of Kernels Dan Fu shares how they use NVIDIA CUDA, TensorRT-LLM, Dynamo and Together ATLAS on NVIDIA Blackwell to power ultra-low-latency inference and long context code generation for Cursor. From building megakernels that fuse an entire model's forward pass into a single launch to enabling real-time voice agents, Together AI is optimizing latency at every layer of the stack.

NVIDIA AI Infrastructure

20,770 views • 3 months ago

The NVIDIA Vera Rubin platform is a multi-rack pod-scale system, built to process agentic AI and is now in full production. Built through extreme co-design, Vera Rubin unifies five connected rack-scale systems — the NVIDIA Vera Rubin NVL72, Vera CPU rack, Groq 3 LPX, Vera BlueField-4 STX, and Spectrum-6 SPX Ethernet — all purpose-built for global-scale agentic AI infrastructure. Vera Rubin delivers intelligence at scale, with the performance, efficiency and security needed to power the next industrial revolution. Congratulations to Microsoft, Dell Technologies, and CoreWeave for each standing up their Vera Rubin NVL72 engineering racks. Learn more:

The NVIDIA Vera Rubin platform is a multi-rack pod-scale system, built to process agentic AI and is now in full production. Built through extreme co-design, Vera Rubin unifies five connected rack-scale systems — the NVIDIA Vera Rubin NVL72, Vera CPU rack, Groq 3 LPX, Vera BlueField-4 STX, and Spectrum-6 SPX Ethernet — all purpose-built for global-scale agentic AI infrastructure. Vera Rubin delivers intelligence at scale, with the performance, efficiency and security needed to power the next industrial revolution. Congratulations to Microsoft, Dell Technologies, and CoreWeave for each standing up their Vera Rubin NVL72 engineering racks. Learn more:

NVIDIA

49,740 views • 4 months ago

Nvidia CEO Jensen Huang talks through the Vera Rubin System at Nvidia GTC 2026.

Nvidia CEO Jensen Huang talks through the Vera Rubin System at Nvidia GTC 2026.

CNET

10,321,870 views • 6 months ago

📣 MLPerf Inference v6.0 results are in. Learn how systems powered by NVIDIA Blackwell set the pace on inference, delivering the highest AI factory throughput. 🔗

📣 MLPerf Inference v6.0 results are in. Learn how systems powered by NVIDIA Blackwell set the pace on inference, delivering the highest AI factory throughput. 🔗

NVIDIA AI Infrastructure

34,071 views • 6 months ago

vLLM now supports NVIDIA Vera Rubin. The early results show more than 7.8x the throughput of GB200 on MiniMax M3 on AgentX. Inferact, NVIDIA AI, Red Hat AI, and the vLLM community have been bringing vLLM up on Rubin since it was announced. Here is where things stand. 🧵 1/5

vLLM now supports NVIDIA Vera Rubin. The early results show more than 7.8x the throughput of GB200 on MiniMax M3 on AgentX. Inferact, NVIDIA AI, Red Hat AI, and the vLLM community have been bringing vLLM up on Rubin since it was announced. Here is where things stand. 🧵 1/5

vLLM

84,197 views • 15 days ago

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️

🤝 Alphabet and NVIDIA are expanding their decade-long partnership to advance agentic AI, robotics, drug discovery, and more. This involves deep co-engineering with integrated platforms, open-source frameworks, and managed services. ✅ Google Cloud is one of the first to bring the NVIDIA Blackwell platform to the cloud. ✅ Google Distributed Cloud using NVIDIA Confidential Computing on #NVIDIABlackwell for enterprises to run Google Gemini on-premises. ✅ Integration of the NVIDIA AI platform across Vertex AI, Cluster Director and Google Kubernetes Engine. ✅ Bringing the NVIDIA Nemotron family of open models to Vertex AI Model Garden. Watch the full video to learn more ➡️

NVIDIA AI Infrastructure

268,567 views • 9 months ago

$NVDA Vera Rubin cycle is officially moving from roadmap to reality with the first operational NVL72 rack now live at $MSFT. Nvidia says production racks are here marking the start of the next major AI infrastructure deployment wave after Blackwell.

$NVDA Vera Rubin cycle is officially moving from roadmap to reality with the first operational NVL72 rack now live at $MSFT. Nvidia says production racks are here marking the start of the next major AI infrastructure deployment wave after Blackwell.

Shay Boloor

94,910 views • 2 months ago