正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Introducing Entelligence AI Model Router, dynamic turn based routing trained on engineering tasks that cuts costs by over 50% Automatically route every coding turn to the model with the best balance of quality, latency, and cost. Escalate to frontier models when they’re actually needed Balanced mode reduces spend by... show more

Aiswarya Sankar

10,560 subscribers

87,516 次观看 • 3 个月前 •via X (Twitter)

科学技术财经

Anya Rossi• Live Now

Private livecam show

43 条评论

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

Check it out here:

conor brennan-burke 的头像

conor brennan-burke3 个月前

@EntelligenceAI this is so sick, awesome product

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI 🙌 no more being an anthropic revenue machine

conor brennan-burke 的头像

conor brennan-burke3 个月前

@EntelligenceAI own your own tokens

Divya Porwal 的头像

Divya Porwal3 个月前

@EntelligenceAI This is actually the most needed thing to save money in this AI era

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI Agreed

Gipp 🦅 的头像

Gipp 🦅3 个月前

@EntelligenceAI eco mode saving over 76% is honestly wild efficiency

PARSA 的头像

PARSA3 个月前

@EntelligenceAI 76% savings on eco mode is wild. Inference cost is quietly becoming the biggest line item for AI teams

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI Exactly teams we talk to spend millions now in internal Eng budgets

D4rsh🦅 的头像

D4rsh🦅3 个月前

@EntelligenceAI cutting ai spend in half without changing workflow sounds too good gonna test hehe

Rahul 的头像

Rahul3 个月前

@EntelligenceAI this is what most people want now. reduce AI costs but still need quality outputs

Aman 的头像

Aman3 个月前

@EntelligenceAI curious to see real world benchmarks

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI Try it out! Pay as you go or bring your own key so it’s as simple as possible

Đức Ca Ca 🇻🇳 的头像

Đức Ca Ca 🇻🇳3 个月前

@EntelligenceAI Sounds like a game changer in cost-efficient engineering tasks!

Sanskriti Naruka 的头像

Sanskriti Naruka3 个月前

@EntelligenceAI Dynamic routing is the API cost killer we've been waiting for.

Pranavvv👾 的头像

Pranavvv👾3 个月前

@EntelligenceAI sounds good :)

Aditi 的头像

Aditi3 个月前

@EntelligenceAI The cost savings could add up really fast

Nischit 的头像

Nischit3 个月前

@EntelligenceAI 2 questions: - is this free to use ? Open source repo that anybody can start using ? - impact output quality

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI Free if you bring your own key Results on terminal bench here -

Archy Gupta 的头像

Archy Gupta3 个月前

@EntelligenceAI Much needed. We needed support in choosing the right and most efficient model. 🙌

Karan 的头像

Karan3 个月前

@EntelligenceAI Cutting costs by over 50% is insane

🤝 Zubin Pahuja 的头像

🤝 Zubin Pahuja3 个月前

@EntelligenceAI this is some voodoo magic fr tried it on a task that torched my daily fable limit. same quality output, howww??

Manish Kumar Shah 的头像

Manish Kumar Shah3 个月前

@EntelligenceAI This is a practical approach to making AI coding more cost-efficient.

Atenov int. 的头像

Atenov int.3 个月前

@EntelligenceAI Balanced routing makes sense if teams can still force a higher tier on tricky debugging turns

Vaibhav Sisinty 的头像

Vaibhav Sisinty3 个月前

@EntelligenceAI much needed!

Kizyto 的头像

Kizyto3 个月前

@EntelligenceAI Eco mode at 76% savings is wild. If it's that much cheaper, why wouldn't everyone use it? What's the quality tradeoff?

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI See the full results here -

Val ⟠ 的头像

Val ⟠3 个月前

@EntelligenceAI This kind of smart routing feels like the future of AI

Zahle Khan 的头像

Zahle Khan3 个月前

@EntelligenceAI

Manoj Kumar Shah 的头像

Manoj Kumar Shah3 个月前

@EntelligenceAI This could make AI coding much more accessible for engineering teams.

Khilesh | AI Tools 的头像

Khilesh | AI Tools3 个月前

@EntelligenceAI this is so sick, awesome product

Deb Mukherjee 的头像

Deb Mukherjee3 个月前

@EntelligenceAI Noice!

Shara 的头像

Shara3 个月前

@EntelligenceAI Dynamic routing trained specifically on engineering tasks is a smart specialization.

Aditi.py 的头像

Aditi.py3 个月前

@EntelligenceAI So can I use my claude max plan with this or its just for api based usage?

Hussain Hashim | Building SundayBack 的头像

Hussain Hashim | Building SundayBack3 个月前

@EntelligenceAI @Aiswarya_Sankar this sounds like a game-changer for optimizing coding workflows. curious how it decides which model to escalate to though.

Jason傑森 🇭🇰 | 🛠️ 的头像

Jason傑森 🇭🇰 | 🛠️3 个月前

@EntelligenceAI hmm挺省钱的

AI_Explorer 的头像

AI_Explorer3 个月前

@EntelligenceAI This looks very interesting

Karan🧋 的头像

Karan🧋3 个月前

@EntelligenceAI This will be a game changer, we do need standardized routing

Mishika AI 的头像

Mishika AI3 个月前

@EntelligenceAI It's interesting how the conversation has shifted from "best model" to "best workflow."

Fokki 的头像

Fokki3 个月前

@EntelligenceAI Impressive updates

Adithya Krishna 的头像

Adithya Krishna3 个月前

@EntelligenceAI this is soo cool!!

Nahid 的头像

Nahid3 个月前

@EntelligenceAI eco mode saving over 76% can really help teams

Aiswarya Sankar 的头像

Aiswarya Sankar3 个月前

@EntelligenceAI Full analysis here -

相关视频

Introducing model routing to Factory. Factory Router picks the right model for every task, automatically. Maintain frontier performance while cutting costs by 25%.

Introducing model routing to Factory. Factory Router picks the right model for every task, automatically. Maintain frontier performance while cutting costs by 25%.

Factory

2,271,540 次观看 • 4 个月前

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Introducing Smart Routing in Unity AI Gateway. Stop overpaying for AI. Smart Routing matches each coding task to the right model and harness based on what the task needs, so higher-cost models can differentiate on intelligence while lower-cost models differentiate on cost and performance. Match frontier quality and cut task costs by 30%+.

Databricks

126,791 次观看 • 2 个月前

🚨 GMI estimated ~$0.11 in savings on one 3-step Python coding workflow. I gave GMI Router the same e-commerce codebase and split the work into 3 requests: 👉 Code analysis → Cost Mode → DeepSeek-V4-Flash → ~$0.046 saved 👉 Debugging → Balanced Mode → DeepSeek-V4-Flash → ~$0.042 saved 👉 Implementation + testing → Quality Mode → DeepSeek-V4-Flash → ~$0.019 saved Total: ~$0.11 estimated savings vs Claude Opus 4.8, based on GMI's estimated token usage. But here's what caught my attention: Router selected the same model for all 3 tasks — even though I changed the mode each time. And that's actually the point. GMI Cloud 's Router is cache-aware. When the same model can handle the next request, sticking with it can help preserve cache reuse and reduce cost. There's another reason: These tasks weren't especially difficult. So even in Quality Mode, Router didn't need to move to a heavier model. The result: 1 codebase. 3 tasks. 3 routing modes. 1 lightweight model. ~$0.11 estimated savings. This is why request-level routing is more interesting than simply assigning a different model to every task.

🚨 GMI estimated ~$0.11 in savings on one 3-step Python coding workflow. I gave GMI Router the same e-commerce codebase and split the work into 3 requests: 👉 Code analysis → Cost Mode → DeepSeek-V4-Flash → ~$0.046 saved 👉 Debugging → Balanced Mode → DeepSeek-V4-Flash → ~$0.042 saved 👉 Implementation + testing → Quality Mode → DeepSeek-V4-Flash → ~$0.019 saved Total: ~$0.11 estimated savings vs Claude Opus 4.8, based on GMI's estimated token usage. But here's what caught my attention: Router selected the same model for all 3 tasks — even though I changed the mode each time. And that's actually the point. GMI Cloud 's Router is cache-aware. When the same model can handle the next request, sticking with it can help preserve cache reuse and reduce cost. There's another reason: These tasks weren't especially difficult. So even in Quality Mode, Router didn't need to move to a heavier model. The result: 1 codebase. 3 tasks. 3 routing modes. 1 lightweight model. ~$0.11 estimated savings. This is why request-level routing is more interesting than simply assigning a different model to every task.

Anthara Fairooz

28,520 次观看 • 2 个月前

Introducing Shift-1, a frontier coding router trained on AC2 that reduced coding agent cost by up to 55% with no noticeable drop in quality. Try it at

Introducing Shift-1, a frontier coding router trained on AC2 that reduced coding agent cost by up to 55% with no noticeable drop in quality. Try it at

Applied Compute

49,222 次观看 • 6 天前

The right model depends on the task. NVIDIA NeMo Switchyard helps developers route each agent workflow step across a chosen model pool based on their own quality, latency and cost criteria. Kari Briski joins MTS to explain why agent workflows need model routing.

The right model depends on the task. NVIDIA NeMo Switchyard helps developers route each agent workflow step across a chosen model pool based on their own quality, latency and cost criteria. Kari Briski joins MTS to explain why agent workflows need model routing.

NVIDIA

97,320 次观看 • 2 个月前

Ran a real 3-turn LinkedIn research workflow through GMI Cloud Router in Balanced mode. Here’s what it actually picked, turn by turn : Turn 1 — “Research 2026 AI/marketing trends and summarize 5 insights” → DeepSeek-V4-Flash-0731 → ~$0.047 cheaper than Claude Opus 4.8 Turn 2 — “Analyze those insights for content angles + pain points” → GPT-5.6-Luna → ~$0.026 saved vs Opus 4.8 Turn 3 — “Turn the top angle into 5 LinkedIn post concepts” → GPT-5.6-Luna → ~$0.040 saved vs Opus 4.8 Total estimated savings: ~$0.11 across 3 turns. The interesting part was Turns 2 and 3. The task changed from analysis to writing, but Router stayed on GPT-5.6-Luna. That makes sense because GMI Router is cache-aware: when the same model can still handle the next task well, staying on that model can preserve cache reuse and avoid the cost of re-serving the context to another model. And all 3 tasks were relatively lightweight. They didn't suddenly require a more expensive frontier model just because the task type changed. So the routing wasn't about constantly switching models. It was about finding a model that was good enough for the task while keeping the cost down, and staying there when that still made sense. That’s a much more interesting way to think about model routing. GMI Cloud #AI #LLM #AIAgents #GenerativeAI

Ran a real 3-turn LinkedIn research workflow through GMI Cloud Router in Balanced mode. Here’s what it actually picked, turn by turn : Turn 1 — “Research 2026 AI/marketing trends and summarize 5 insights” → DeepSeek-V4-Flash-0731 → ~$0.047 cheaper than Claude Opus 4.8 Turn 2 — “Analyze those insights for content angles + pain points” → GPT-5.6-Luna → ~$0.026 saved vs Opus 4.8 Turn 3 — “Turn the top angle into 5 LinkedIn post concepts” → GPT-5.6-Luna → ~$0.040 saved vs Opus 4.8 Total estimated savings: ~$0.11 across 3 turns. The interesting part was Turns 2 and 3. The task changed from analysis to writing, but Router stayed on GPT-5.6-Luna. That makes sense because GMI Router is cache-aware: when the same model can still handle the next task well, staying on that model can preserve cache reuse and avoid the cost of re-serving the context to another model. And all 3 tasks were relatively lightweight. They didn't suddenly require a more expensive frontier model just because the task type changed. So the routing wasn't about constantly switching models. It was about finding a model that was good enough for the task while keeping the cost down, and staying there when that still made sense. That’s a much more interesting way to think about model routing. GMI Cloud #AI #LLM #AIAgents #GenerativeAI

Tom

29,592 次观看 • 2 个月前

Introducing Runway Media Router. The first preference-optimized router for generative media. Instead of hand-picking a model for every request, you define what "best" means once, for cost, quality, or latency, and the router selects the right video, image, or audio model automatically. Live now in Runway Dev.

Introducing Runway Media Router. The first preference-optimized router for generative media. Instead of hand-picking a model for every request, you define what "best" means once, for cost, quality, or latency, and the router selects the right video, image, or audio model automatically. Live now in Runway Dev.

Runway

62,291 次观看 • 3 个月前

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Today we're releasing Not Diamond… The world’s most powerful AI model router. Not Diamond maximizes LLM output quality by automatically recommending the best LLM on every request at lower cost and latency. And it takes <5m to set up. Watch this to see how to start using it:

Tomas Hernando Kofman

77,096 次观看 • 2 年前

Nobody cares that you process 2B tokens. That’s not a flex, it’s a bill. Introducing Entelligence AI Agent Insights - Track not just dollars spent but actual ROI We built Agent Insights to map AI spend straight to engineering outcomes: features, fixes, and PRs Manage your budget based on actual company priorities Cut your spend in half with the Entelligence model router See what your AI spend actually shipped:

Nobody cares that you process 2B tokens. That’s not a flex, it’s a bill. Introducing Entelligence AI Agent Insights - Track not just dollars spent but actual ROI We built Agent Insights to map AI spend straight to engineering outcomes: features, fixes, and PRs Manage your budget based on actual company priorities Cut your spend in half with the Entelligence model router See what your AI spend actually shipped:

Aiswarya Sankar

70,557 次观看 • 3 个月前

Introducing Cursor Router, our intelligent model router that selects the right model for the task at hand. Router delivers frontier-quality results at 60% lower cost.

Introducing Cursor Router, our intelligent model router that selects the right model for the task at hand. Router delivers frontier-quality results at 60% lower cost.

Cursor

2,677,934 次观看 • 3 个月前

Introducing EVO Router - a smart router that continuously optimizes and hill-climbs on your AI inference workloads. It learns from your code, prompts, production traffic, use cases, and SLAs, then searches for the best setup for every workload. That can mean more than choosing just a single model or routing through a classifier. @EVO__HQ can optimize across model × provider combinations, fusion systems, cascades, routing policies, and prompts — whatever the workload allows, while staying within your quality, latency, and reliability constraints. As open-source models move closer to frontier-model performance, we believe this kind of workload-specific hill-climbing will become an important part of how AI systems are deployed and operated. Our early users have seen 30–60% lower inference costs across use cases ranging from complex multi-turn agents to asynchronous batch workloads. EVO Router has also reached the Pareto frontier on several benchmarks, outperforming existing setups on cost, quality, or both.

Introducing EVO Router - a smart router that continuously optimizes and hill-climbs on your AI inference workloads. It learns from your code, prompts, production traffic, use cases, and SLAs, then searches for the best setup for every workload. That can mean more than choosing just a single model or routing through a classifier. @EVO__HQ can optimize across model × provider combinations, fusion systems, cascades, routing policies, and prompts — whatever the workload allows, while staying within your quality, latency, and reliability constraints. As open-source models move closer to frontier-model performance, we believe this kind of workload-specific hill-climbing will become an important part of how AI systems are deployed and operated. Our early users have seen 30–60% lower inference costs across use cases ranging from complex multi-turn agents to asynchronous batch workloads. EVO Router has also reached the Pareto frontier on several benchmarks, outperforming existing setups on cost, quality, or both.

Alok Bishoyi

16,327 次观看 • 2 个月前

Agent Categories and Costs are now in the Agent Leaderboard! Two questions guide model selection: task-specific performance and cost to completion. Based on analysis of 1.7M+ real-world Agent Mode sessions, the leaderboard now lets users: - Filter the leaderboard by Code, Work, and Chat to compare model performance by task type - View real cost-per-task for each model, including the Pareto frontier of the most cost-efficient options at each performance level

Agent Categories and Costs are now in the Agent Leaderboard! Two questions guide model selection: task-specific performance and cost to completion. Based on analysis of 1.7M+ real-world Agent Mode sessions, the leaderboard now lets users: - Filter the leaderboard by Code, Work, and Chat to compare model performance by task type - View real cost-per-task for each model, including the Pareto frontier of the most cost-efficient options at each performance level

Arena.ai

29,605 次观看 • 2 个月前

Introducing typesafe/jev-router: a cache-aware model router powered by Jev and TypeSafe AI The Jev Router picks the best model and reasoning effort for each request, balancing quality, speed, and cost. Here's how it works 👇🏻

Introducing typesafe/jev-router: a cache-aware model router powered by Jev and TypeSafe AI The Jev Router picks the best model and reasoning effort for each request, balancing quality, speed, and cost. Here's how it works 👇🏻

OpenRouter

1,333,295 次观看 • 1 个月前

Introducing the Morph Model Router. It chooses the best model for each task in under 50ms. Keep frontier performance while lowering latency and cost. Available today in our API

Introducing the Morph Model Router. It chooses the best model for each task in under 50ms. Keep frontier performance while lowering latency and cost. Available today in our API

Morph

20,281 次观看 • 4 个月前

The most effective AI systems don't rely on a single model. Frontier models provide state-of-the-art performance for complex tasks, while routers automatically select lightweight, open-source models for simpler jobs to optimize accuracy, latency, and cost. Learn more:

The most effective AI systems don't rely on a single model. Frontier models provide state-of-the-art performance for complex tasks, while routers automatically select lightweight, open-source models for simpler jobs to optimize accuracy, latency, and cost. Learn more:

NVIDIA AI

12,152 次观看 • 7 个月前

LLM Routing, clearly explained! (routing can cost more than not routing at all) The basic idea sounds simple: Send easy requests to cheaper models and reserve frontier models for difficult tasks. But production routing is rarely that straightforward. Every classification adds latency. General-purpose models can misread intent. Routing rules become outdated. And switching models during an agent session can destroy prefix-cache savings, increase costs, and create inconsistent behavior. In this video, I cover: → Why DIY routing often breaks in production → How prefix caching changes the economics → Why agents need session pinning and model affinity → How Plano and Arch-Router handle intent resolution → How to build, test, and evaluate a router with DigitalOcean Routing works, but only when the infrastructure accounts for the full session, not just the latest request. The real question is not whether routing can reduce costs. It is how much of your AI traffic has been overpaying this whole time. Get started with Digital Ocean inference router: I recently wrote a detailed article on the same topic. The article is quoted below.

LLM Routing, clearly explained! (routing can cost more than not routing at all) The basic idea sounds simple: Send easy requests to cheaper models and reserve frontier models for difficult tasks. But production routing is rarely that straightforward. Every classification adds latency. General-purpose models can misread intent. Routing rules become outdated. And switching models during an agent session can destroy prefix-cache savings, increase costs, and create inconsistent behavior. In this video, I cover: → Why DIY routing often breaks in production → How prefix caching changes the economics → Why agents need session pinning and model affinity → How Plano and Arch-Router handle intent resolution → How to build, test, and evaluate a router with DigitalOcean Routing works, but only when the infrastructure accounts for the full session, not just the latest request. The real question is not whether routing can reduce costs. It is how much of your AI traffic has been overpaying this whole time. Get started with Digital Ocean inference router: I recently wrote a detailed article on the same topic. The article is quoted below.

Akshay 🚀

16,223 次观看 • 21 天前

Monitor and control your AI spend on every provider on Our early users save 40% on average. Every week, the price-intelligence-latency frontier shifts, and we expect this trend to continue. Tradeoffs between latency, reasoning, cost, service tier, open source and closed source models are shifting constantly. Router sends every request to the model that's actually best for the task and helps you control what tokens you buy. We benchmark it against real work: ~40% lower cost for the same outputs. Today we're opening it to everyone. Two lines of code or just change your base URL. No Ramp account needed. Free through 2026, first $26 on us. Get an API key today at

Monitor and control your AI spend on every provider on Our early users save 40% on average. Every week, the price-intelligence-latency frontier shifts, and we expect this trend to continue. Tradeoffs between latency, reasoning, cost, service tier, open source and closed source models are shifting constantly. Router sends every request to the model that's actually best for the task and helps you control what tokens you buy. We benchmark it against real work: ~40% lower cost for the same outputs. Today we're opening it to everyone. Two lines of code or just change your base URL. No Ramp account needed. Free through 2026, first $26 on us. Get an API key today at

Veeral Patel

1,431,133 次观看 • 2 个月前

Introducing: Auto Private Model Routing on June Choose Low, Balanced, or High. June picks the right model for every request. Defaults to zero data retention and private models. Powered by Venice. Free to try. Open source. MIT. Try June:

Introducing: Auto Private Model Routing on June Choose Low, Balanced, or High. June picks the right model for every request. Defaults to zero data retention and private models. Powered by Venice. Free to try. Open source. MIT. Try June:

OpenSoftware

112,941 次观看 • 3 个月前

Introducing Arena Mode in Windsurf: One prompt. Two models. Your vote. Benchmarks don't reflect real-world coding quality. The best model for you depends on your codebase and stack. So we made real-world coding the benchmark. Free for the next week. May the best model win.

Introducing Arena Mode in Windsurf: One prompt. Two models. Your vote. Benchmarks don't reflect real-world coding quality. The best model for you depends on your codebase and stack. So we made real-world coding the benchmark. Free for the next week. May the best model win.

Devin Developers

1,073,277 次观看 • 9 个月前

Introducing Figure out which open model is best for your use case. Compare models across coding, agents, long context, vision, finance, and more. Then see how they compare on cost + quality, including what you could save by moving to open models.

Introducing Figure out which open model is best for your use case. Compare models across coding, agents, long context, vision, finance, and more. Then see how they compare on cost + quality, including what you could save by moving to open models.

Hassan

18,655 次观看 • 1 个月前