Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

The most effective AI systems don't rely on a single model. Frontier models provide state-of-the-art performance for complex tasks, while routers automatically select lightweight, open-source models for simpler jobs to optimize accuracy, latency, and cost. Learn more:

NVIDIA AI

303,654 subscribers

12,152 views • 6 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

n8n workflow to save cost. FREE for next few hours. You don't need oAI o3 for greetings. Select the best model according to needs. - Helps Reduce costs - Knows about latest models automatically - Cheap Models for Simple messages - Complex Models for Complex Tasks Follow + Repost + Reply “SELECT” for n8n workflow via DM (free, no email needed).

n8n workflow to save cost. FREE for next few hours. You don't need oAI o3 for greetings. Select the best model according to needs. - Helps Reduce costs - Knows about latest models automatically - Cheap Models for Simple messages - Complex Models for Complex Tasks Follow + Repost + Reply “SELECT” for n8n workflow via DM (free, no email needed).

Archit Jain

24,347 views • 1 year ago

Meet Amazon Nova 2 reasoning models Nova has introduced its next generation of foundation models that deliver frontier intelligence with industry-leading price performance 1/ Amazon Nova 2 Lite, is a fast, cost-effective model designed for everyday AI tasks. 2/ Amazon Nova 2 Pro (preview), Nova’s most intelligent model built for complex AI workloads. These models offer developers control to manage thinking budgets, native support for agentic workflows, and provide a one-million-token context window for richer interactions.

Meet Amazon Nova 2 reasoning models Nova has introduced its next generation of foundation models that deliver frontier intelligence with industry-leading price performance 1/ Amazon Nova 2 Lite, is a fast, cost-effective model designed for everyday AI tasks. 2/ Amazon Nova 2 Pro (preview), Nova’s most intelligent model built for complex AI workloads. These models offer developers control to manage thinking budgets, native support for agentic workflows, and provide a one-million-token context window for richer interactions.

Amazon Web Services

3,958,154 views • 9 months ago

Today we're shipping Nemotron 3 Ultra. A 550B MoE frontier-intelligence open model built for long-running agents. It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.

Today we're shipping Nemotron 3 Ultra. A 550B MoE frontier-intelligence open model built for long-running agents. It delivers 5x faster inference and lowers the cost of complex agentic tasks by up to 30% versus other open frontier models.

NVIDIA AI

1,329,222 views • 3 months ago

"Most enterprise workflows don't require frontier AI models. Outside of coding, tasks like summarization, document generation, and briefing can often be handled effectively by lower-cost open-source models. The real value is knowing when you need frontier performance and when cheaper models are more than good enough." Michael Mignano What percent of enterprise workflows requires frontier models today Nikesh Arora Matan Grinberg Aaron Katz Lin Qiao

"Most enterprise workflows don't require frontier AI models. Outside of coding, tasks like summarization, document generation, and briefing can often be handled effectively by lower-cost open-source models. The real value is knowing when you need frontier performance and when cheaper models are more than good enough." Michael Mignano What percent of enterprise workflows requires frontier models today Nikesh Arora Matan Grinberg Aaron Katz Lin Qiao

Harry Stebbings

36,428 views • 2 months ago

🚀 Amazon Nova Premier, our most capable teacher model for creating custom distilled models, is now available on Amazon Bedrock! Built for complex tasks like Retrieval-Augmented Generation (RAG), function calling, and agentic coding, its one-million-token context window enables analysis of large datasets while being the most cost-effective proprietary model in its intelligence tier. Learn more:

🚀 Amazon Nova Premier, our most capable teacher model for creating custom distilled models, is now available on Amazon Bedrock! Built for complex tasks like Retrieval-Augmented Generation (RAG), function calling, and agentic coding, its one-million-token context window enables analysis of large datasets while being the most cost-effective proprietary model in its intelligence tier. Learn more:

Amazon Science

42,314 views • 1 year ago

$We partnered with Harvey to train a model for Review Table, achieving state-of-the-art accuracy at a fraction of the cost and latency of frontier alternatives. Review Table is one of Harvey’s highest inference volume products. Training an open source model for production traffic required building a representative eval and understanding how real lawyers use the product. Our teams discuss the research process.$

We partnered with Harvey to train a model for Review Table, achieving state-of-the-art accuracy at a fraction of the cost and latency of frontier alternatives. Review Table is one of Harvey’s highest inference volume products. Training an open source model for production traffic required building a representative eval and understanding how real lawyers use the product. Our teams discuss the research process.

Applied Compute

33,609 views • 29 days ago

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Databricks

125,783 views • 1 month ago

Introducing EVO Router - a smart router that continuously optimizes and hill-climbs on your AI inference workloads. It learns from your code, prompts, production traffic, use cases, and SLAs, then searches for the best setup for every workload. That can mean more than choosing just a single model or routing through a classifier. EVO (YC F26) can optimize across model × provider combinations, fusion systems, cascades, routing policies, and prompts — whatever the workload allows, while staying within your quality, latency, and reliability constraints. As open-source models move closer to frontier-model performance, we believe this kind of workload-specific hill-climbing will become an important part of how AI systems are deployed and operated. Our early users have seen 30–60% lower inference costs across use cases ranging from complex multi-turn agents to asynchronous batch workloads. EVO Router has also reached the Pareto frontier on several benchmarks, outperforming existing setups on cost, quality, or both.

Introducing EVO Router - a smart router that continuously optimizes and hill-climbs on your AI inference workloads. It learns from your code, prompts, production traffic, use cases, and SLAs, then searches for the best setup for every workload. That can mean more than choosing just a single model or routing through a classifier. EVO (YC F26) can optimize across model × provider combinations, fusion systems, cascades, routing policies, and prompts — whatever the workload allows, while staying within your quality, latency, and reliability constraints. As open-source models move closer to frontier-model performance, we believe this kind of workload-specific hill-climbing will become an important part of how AI systems are deployed and operated. Our early users have seen 30–60% lower inference costs across use cases ranging from complex multi-turn agents to asynchronous batch workloads. EVO Router has also reached the Pareto frontier on several benchmarks, outperforming existing setups on cost, quality, or both.

Alok Bishoyi

15,996 views • 1 month ago

Great to be back at another stellar Modular developer conference: #ModCon2026! Thanks to tim for leading a deeply engaging discussion on AI infrastructure, the economics of training and inference, and the looming massive impact of open models. Takeaway: Efficient open models can achieve 90% of frontier performance at 10% of the cost. Soon, most applications outside of science and cybersecurity won’t require frontier models, for the same reason you don't hire a physics PhD for customer support. Congrats to Tim, Chris Lattner, and the entire Modular team on another impressive event (their first as a Qualcomm company!).

Great to be back at another stellar Modular developer conference: #ModCon2026! Thanks to tim for leading a deeply engaging discussion on AI infrastructure, the economics of training and inference, and the looming massive impact of open models. Takeaway: Efficient open models can achieve 90% of frontier performance at 10% of the cost. Soon, most applications outside of science and cybersecurity won’t require frontier models, for the same reason you don't hire a physics PhD for customer support. Congrats to Tim, Chris Lattner, and the entire Modular team on another impressive event (their first as a Qualcomm company!).

Dave Munichiello 🇺🇸

11,661 views • 23 days ago

Introducing Entelligence AI Model Router, dynamic turn based routing trained on engineering tasks that cuts costs by over 50% Automatically route every coding turn to the model with the best balance of quality, latency, and cost. Escalate to frontier models when they’re actually needed Balanced mode reduces spend by 46% per session Eco mode helps teams save > 76%

Introducing Entelligence AI Model Router, dynamic turn based routing trained on engineering tasks that cuts costs by over 50% Automatically route every coding turn to the model with the best balance of quality, latency, and cost. Escalate to frontier models when they’re actually needed Balanced mode reduces spend by 46% per session Eco mode helps teams save > 76%

Aiswarya Sankar

85,571 views • 1 month ago

Open-source AI is catching up fast. At RAISE Summit, Together AI said open models can be 10x–60x more cost-effective than closed models—and questioned the evidence they're a major security threat.

Open-source AI is catching up fast. At RAISE Summit, Together AI said open models can be 10x–60x more cost-effective than closed models—and questioned the evidence they're a major security threat.

TIME

4,073,820 views • 1 month ago

Reasoning models tailored for diverse AI tasks. 🚀 Meet Amazon Nova 2 foundation models, supporting fast, cost-effective reasoning to multimodal capabilities. Power versatile tasks like AI agents, code-generation, and Conversational AI. Choose the perfect match for your workload.

Reasoning models tailored for diverse AI tasks. 🚀 Meet Amazon Nova 2 foundation models, supporting fast, cost-effective reasoning to multimodal capabilities. Power versatile tasks like AI agents, code-generation, and Conversational AI. Choose the perfect match for your workload.

Amazon Web Services

2,074,736 views • 9 months ago

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

We're releasing HY-Embodied-0.5, a family of foundation models for real-world embodied agents. The 2B model is now open source. It strengthens spatial-temporal perception and embodied reasoning for prediction, interaction, and planning. 🤖 The suite includes: 🔹 2B for edge deployment 🔹 32B for complex reasoning Key innovations: 🔹 Mixture-of-Transformers (MoT) architecture for modality-specific computation 🔹 Latent tokens for improved perceptual representation 🔹 Self-evolving post-training 🔹 On-policy distillation from large to small models Across 22 benchmarks, the 2B model outperforms similarly sized SOTA systems on 16 tasks. The 32B model approaches frontier-level performance. 🔗 GitHub: 🤗 Hugging Face:

Tencent Hy

34,317 views • 5 months ago

🚨 AI Can Build Complex Apps With Just One Single Prompt New AI models may be banned but multi-LLM agents can build insane things.... Here is our agent building an entire Slack-like app using a single prompt! Combines Opus, GPT 5.5 and open-source LLMs to optimize cost and performance

🚨 AI Can Build Complex Apps With Just One Single Prompt New AI models may be banned but multi-LLM agents can build insane things.... Here is our agent building an entire Slack-like app using a single prompt! Combines Opus, GPT 5.5 and open-source LLMs to optimize cost and performance

Bindu Reddy

6,663,574 views • 2 months ago

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.

Today we're announcing Base Labs, a dedicated research organization focused on advancing open-source AI. We believe in a healthy, open frontier model ecosystem. To enable this, we are working on: - Blue-sky research on continual learning, the science of RL, and how models learn across their full lifecycle, with every experiment and recipe shared openly. - The BaseHub Data Foundry: the highest-quality open RL environments, training data, and real-world benchmarks, built for anyone to train and benchmark on. - Post-post training: taking open-source models and making them better, safer, and more aligned through continual post-training, built on our research, and deployed with our frontier safety stack so organizations can use open-source models with confidence. - Making models cheaper and more performant through our model performance research. This is a mission-driven research effort, not a commercial product. We believe the health of the open-source AI ecosystem matters and that the best way to advance it is to do science in the open. We’re hiring engineers, researchers, and research fellows to advance this mission.

Base Labs

227,367 views • 9 days ago

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.

.Vogent Voicelab is a high-performance API to run top open-source voice models, like Sesame CSM-1B, Dia, and more. Voicelab optimizes inference for each model so you can run them quickly and scalably— and they post-train select models to improve performance and reliability.

Y Combinator

55,257 views • 1 year ago

China is once again unsettling its American competitors in the AI race. Chinese labs have returned to the spotlight with the unveiling of GLM 5.2, described as the most powerful AI model ever trained in China — and one of the leading open‑source models worldwide. 🔍 Key highlights of “GLM 5.2”: ♦️ It is considered the strongest AI model developed in China to date, and ranks among the smartest open‑source models available. ♦️ It operates at a cost less than one‑tenth that of Anthropic’s latest models, making it a far more economical option. ♦️ It is likely to attract developers and companies seeking powerful, low‑cost models — especially amid growing technical and geopolitical restrictions. ♦️ Some evaluations place the model among the top globally, trailing OpenAI’s models while outperforming several competitors in specialized benchmarks and performance tests.

China is once again unsettling its American competitors in the AI race. Chinese labs have returned to the spotlight with the unveiling of GLM 5.2, described as the most powerful AI model ever trained in China — and one of the leading open‑source models worldwide. 🔍 Key highlights of “GLM 5.2”: ♦️ It is considered the strongest AI model developed in China to date, and ranks among the smartest open‑source models available. ♦️ It operates at a cost less than one‑tenth that of Anthropic’s latest models, making it a far more economical option. ♦️ It is likely to attract developers and companies seeking powerful, low‑cost models — especially amid growing technical and geopolitical restrictions. ♦️ Some evaluations place the model among the top globally, trailing OpenAI’s models while outperforming several competitors in specialized benchmarks and performance tests.

China pulse 🇨🇳

14,293 views • 2 months ago

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.

The future of enterprise AI is increasingly open. Hear AT&T CTO Jeremy Legg discuss how his team is using AMD solutions to support its growing adoption of open-source AI models while increasing accuracy and lowering cost.

AMD

37,500 views • 1 month ago

Are open-source AI models catching up? Erik Voorhees tells David it depends on the benchmark. But if an open model can match frontier AI from a few months ago at 10% of the cost, that's worth watching. What's your take?

Are open-source AI models catching up? Erik Voorhees tells David it depends on the benchmark. But if an open model can match frontier AI from a few months ago at 10% of the cost, that's worth watching. What's your take?

Bitcoin.com News

32,552 views • 2 months ago

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

As AI labs race to train and deploy new frontier models, existing models become more affordable with better tokenomics. ✨ "Everybody's trying to get to the next frontier. And every time they get to the next frontier, the last generation AI tokens, the cost starts to decline about a factor of 10x every year," said NVIDIA CEO Jensen Huang in a recent keynote. Model optimization techniques such as speculative decoding and multi-token prediction, combined with inference serving platforms like NVIDIA Dynamo on NVIDIA Blackwell NVL72 systems, enable AI factories to boost throughput by 10x with one-tenth of the cost per token. Learn more about AI factory tokenomics ➡️

NVIDIA AI

16,053 views • 7 months ago