Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Time to first token has become a defining metric for how AI performs in production. Watch the full panel with NVIDIA and VΛST Data:

Nscale

2,850 subscribers

87,862 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

2 Comments

投資ちゃんです！1 month ago

@nvidia @VAST_Data TTFT、たしかに実用面ではすごく大事になってきましたよね。NVIDIAとVAST Dataのパネル、気になります！

⊹ Sophia ✿1 month ago

@nvidia @VAST_Data is ttft measured raw or through the load balancer? cause prod numbers always tell a different story

Related Videos

Scale and sovereignty don’t always come from the same blueprint. Jason Hammons, VP Systems Engineering – International at VΛST Data, discusses how a distributed inference strategy can provide organizations with a single, policy-driven architecture that holds up at production scale.

Scale and sovereignty don’t always come from the same blueprint. Jason Hammons, VP Systems Engineering – International at VΛST Data, discusses how a distributed inference strategy can provide organizations with a single, policy-driven architecture that holds up at production scale.

Nscale

138,932 views • 2 months ago

Enterprises should own their intelligence. That means bringing AI to their sensitive data while protecting both business data and proprietary models. NVIDIA’s Justin Boitano and VΛST Data Renen Hallak discuss how NVIDIA Confidential Computing makes this possible.

Enterprises should own their intelligence. That means bringing AI to their sensitive data while protecting both business data and proprietary models. NVIDIA’s Justin Boitano and VΛST Data Renen Hallak discuss how NVIDIA Confidential Computing makes this possible.

NVIDIA

72,011 views • 9 days ago

NVIDIA AI Aerial uses neural networks to learn from data, adapt in real time, and scale with complexity. This boosts spectral efficiency, lowers costs, and improves connectivity for telecom. To learn more, watch the full video ➡️

NVIDIA AI Aerial uses neural networks to learn from data, adapt in real time, and scale with complexity. This boosts spectral efficiency, lowers costs, and improves connectivity for telecom. To learn more, watch the full video ➡️

NVIDIA AI

11,275 views • 1 year ago

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.

🎙️ Want a full breakdown on why cost per token is a key metric for AI infrastructure TCO? We’re operating in a power-constrained world. Demand for intelligence is scaling faster than infrastructure can keep up—so metrics like cost per GPU hour or FLOPs per dollar don’t tell the full story. When it comes to TCO, Cost per Token is the metric that captures end-to-end performance across GPUs, CPUs, networking, software, and ecosystem making it the key driver of real profitability and scalability in AI. If you’re not measuring efficiency at the token level, you’re missing what actually drives cost. Watch the deep-dive conversation with Dr. Gerro Prinsloo , Nader Khalil and Carter Abdallah, live on the NVIDIA YouTube channel.

NVIDIA

21,970 views • 5 months ago

Andrew meets with John, where they discuss Supermicro and VΛST Data's collaboration on exciting storage projects such as the CNode-X AI Data Platform. Learn more about Supermicro and VAST Data's AI and Storage solutions: #Supermicro #VASTData #NVIDIA

Andrew meets with John, where they discuss Supermicro and VΛST Data's collaboration on exciting storage projects such as the CNode-X AI Data Platform. Learn more about Supermicro and VAST Data's AI and Storage solutions: #Supermicro #VASTData #NVIDIA

Supermicro

66,105 views • 6 months ago

Sat down with Kari Ann Briski, VP of Generative AI Software for Enterprise @ NVIDIA, to discuss NVIDIA’s Nemotron open models, how training data can be used for building agentic systems, and scaled AI enterprise adoption. Thank you to Kari NVIDIA AI Developer for taking the time!

Sat down with Kari Ann Briski, VP of Generative AI Software for Enterprise @ NVIDIA, to discuss NVIDIA’s Nemotron open models, how training data can be used for building agentic systems, and scaled AI enterprise adoption. Thank you to Kari NVIDIA AI Developer for taking the time!

amit

65,323 views • 8 months ago

AI has become the core growth engine for telecom operations, networks, and services. NVIDIA’s 2026 State of AI in Telecommunications Report shares data from over 1,000 global professionals on how companies are investing in, deploying, and benefiting from AI. Learn about the key use cases driving AI deployment and see how telcos are planning for growing AI traffic.

AI has become the core growth engine for telecom operations, networks, and services. NVIDIA’s 2026 State of AI in Telecommunications Report shares data from over 1,000 global professionals on how companies are investing in, deploying, and benefiting from AI. Learn about the key use cases driving AI deployment and see how telcos are planning for growing AI traffic.

NVIDIA

29,408 views • 5 months ago

📣 Our CEO Jensen Huang sat down with NetApp CEO George Kurian to discuss our partnership and how we're reinventing enterprise data platforms for the age of AI reasoning. #NetAppINSIGHT 🔗 Watch the full fireside chat:

📣 Our CEO Jensen Huang sat down with NetApp CEO George Kurian to discuss our partnership and how we're reinventing enterprise data platforms for the age of AI reasoning. #NetAppINSIGHT 🔗 Watch the full fireside chat:

NVIDIA

38,365 views • 11 months ago

NVIDIA Vera Rubin is in full production and arrives just in time for the next frontier of AI. The #NVIDIARubin platform uses extreme co-design across six new chips to accelerate agentic AI, advanced reasoning and massive-scale MoE model inference. NVIDIA Vera Rubin NVL72: Six new chips, one AI supercomputer — see how we built it.

NVIDIA Vera Rubin is in full production and arrives just in time for the next frontier of AI. The #NVIDIARubin platform uses extreme co-design across six new chips to accelerate agentic AI, advanced reasoning and massive-scale MoE model inference. NVIDIA Vera Rubin NVL72: Six new chips, one AI supercomputer — see how we built it.

NVIDIA Data Center

27,643 views • 8 months ago

Sat down with Dion Harris, Senior Director of HPC and AI Infrastructure Solutions @ NVIDIA, to discuss how AI factories are scaling, complexities within global supply chains, and Nvidia’s latest GPU architecture, Vera Rubin. Thank you to Dion NVIDIA Data Center for taking the time!

Sat down with Dion Harris, Senior Director of HPC and AI Infrastructure Solutions @ NVIDIA, to discuss how AI factories are scaling, complexities within global supply chains, and Nvidia’s latest GPU architecture, Vera Rubin. Thank you to Dion NVIDIA Data Center for taking the time!

amit

76,014 views • 8 months ago

Every business has different data, workflows and standards. Its AI should reflect that. Watch to see how NVIDIA Nemotron open models help teams build specialized AI they can trust, control and customize, then improve against the outcomes that matter most.

Every business has different data, workflows and standards. Its AI should reflect that. Watch to see how NVIDIA Nemotron open models help teams build specialized AI they can trust, control and customize, then improve against the outcomes that matter most.

NVIDIA

76,993 views • 1 month ago

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

NVIDIA AI

16,053 views • 8 months ago

.Cohere is defining the future of sovereign AI. Autumn Moulder, VP of Engineering at Cohere, breaks down the requirements for a full AI sovereign stack at #NVIDIAGTC: ✅ Full-Stack Sovereignty: Deploying everything from the model to applications and reasoning traces within a single data center. ✅ The Power of Openness: Why open models like NVIDIA Nemotron are critical for data lineage and navigating evolving regulations.

.Cohere is defining the future of sovereign AI. Autumn Moulder, VP of Engineering at Cohere, breaks down the requirements for a full AI sovereign stack at #NVIDIAGTC: ✅ Full-Stack Sovereignty: Deploying everything from the model to applications and reasoning traces within a single data center. ✅ The Power of Openness: Why open models like NVIDIA Nemotron are critical for data lineage and navigating evolving regulations.

NVIDIA AI

10,965 views • 6 months ago

Watch how Supermicro and NVIDIA are enabling energy-efficient, AI-optimized data centers built for tomorrow’s most demanding workloads.

Watch how Supermicro and NVIDIA are enabling energy-efficient, AI-optimized data centers built for tomorrow’s most demanding workloads.

Supermicro

80,007,612 views • 1 year ago

Watch how NVIDIA & Inworld AI bring AI characters to life with NVIDIA ACE digital human technologies and the Inworld Engine in the latest technology demo, Covert Protocol. Learn More:

Watch how NVIDIA & Inworld AI bring AI characters to life with NVIDIA ACE digital human technologies and the Inworld Engine in the latest technology demo, Covert Protocol. Learn More:

NVIDIA GeForce

184,342 views • 2 years ago

Telecom infrastructure is becoming a distributed AI compute layer, unlocking smarter cities and more efficient operations. NVIDIA AI-RAN and NVIDIA Metropolis Blueprint for video search and summarization enable AI agents to run continuously at the edge. These agents analyze real-time data streams from connected sensors over 5G to power live monitoring and infrastructure inspection. ▶️ Watch the full video to learn more:

Telecom infrastructure is becoming a distributed AI compute layer, unlocking smarter cities and more efficient operations. NVIDIA AI-RAN and NVIDIA Metropolis Blueprint for video search and summarization enable AI agents to run continuously at the edge. These agents analyze real-time data streams from connected sensors over 5G to power live monitoring and infrastructure inspection. ▶️ Watch the full video to learn more:

NVIDIA AI

11,078 views • 5 months ago

Watch our CEO Jensen Huang outline the blueprint for America’s AI century in Washington, D.C. at NVIDIA GTC. From national AI infrastructure and quantum computing to robotics and reindustrialization, see how NVIDIA and its partners are advancing America's AI leadership.

Watch our CEO Jensen Huang outline the blueprint for America’s AI century in Washington, D.C. at NVIDIA GTC. From national AI infrastructure and quantum computing to robotics and reindustrialization, see how NVIDIA and its partners are advancing America's AI leadership.

NVIDIA

834,213 views • 11 months ago

The age of video analytics #AIagents is here. 🎥 From factory to smart cities, enterprises like Pegatron, Linker Vision, VΛST Data, and Siemens are using #generativeAI to see, search, and summarize massive volumes of video—at scale. Explore how the NVIDIA AI Blueprint for video search and summarization (VSS) from #NVIDIAMetropolis is powering this shift. ➡️ #COMPUTEX2025

The age of video analytics #AIagents is here. 🎥 From factory to smart cities, enterprises like Pegatron, Linker Vision, VΛST Data, and Siemens are using #generativeAI to see, search, and summarize massive volumes of video—at scale. Explore how the NVIDIA AI Blueprint for video search and summarization (VSS) from #NVIDIAMetropolis is powering this shift. ➡️ #COMPUTEX2025

NVIDIA AI

20,775 views • 1 year ago

Vera Rubin is in full production. We just kicked off the next generation of AI infrastructure with the NVIDIA Rubin platform, bringing together six new chips to deliver one AI supercomputer built for AI at scale. Here are the top 5 things to know 🧵

Vera Rubin is in full production. We just kicked off the next generation of AI infrastructure with the NVIDIA Rubin platform, bringing together six new chips to deliver one AI supercomputer built for AI at scale. Here are the top 5 things to know 🧵

NVIDIA

817,297 views • 8 months ago