正在加载视频...

视频加载失败

ICYMI: Not every step in an agent workflow needs the same model. Meet NVIDIA NeMo Switchyard, a new open-source library for model routing. Use frontier models for complex reasoning and planning, and NVIDIA Nemotron Lightning for high-volume, specialized execution.

16,629 次观看 • 1 个月前 •via X (Twitter)

15 条评论

NVIDIA AI 的头像
NVIDIA AI1 个月前

Learn more:

Joe Stevens 的头像
Joe Stevens1 个月前

🕸🤖🕸

TerraByte AI 的头像
TerraByte AI1 个月前

Geospatial search is a good routing test. A small model can handle place, date and sensor filters. Only ambiguous queries like “recent burn scars near vineyards” need the expensive model.

无限未来 的头像
无限未来1 个月前

你好,为什么测试你们平台的模型,几乎全部都连接失败,使用测试成功的模型也经常报错

REVELATOR 的头像
REVELATOR1 个月前

@grok exine structure closely matched modern maize pollen.

Alex Lee 的头像
Alex Lee1 个月前

This is the direction agents are heading 👀 Right model, right task, better efficiency 🚀

freesoul 的头像
freesoul1 个月前

Looking forward to testing the escalation and prefill routers in real workflows.

Patch 的头像
Patch1 个月前

I thought we already had model routing….?

Strategize Labs 的头像
Strategize Labs1 个月前

Routing to the right model depending on the job size and complexity. That's how you get real cost compression and value for your bucks.

Gokulan Vikash 的头像
Gokulan Vikash23 天前

Can I talk to someone from this team? Why is this not ready/useable for production workload?

Francesco Di Costanzo 的头像
Francesco Di Costanzo1 个月前

Could my @openclaw pass the message to the router which then dispatches to the right model? That would be cool (provided it works). Equally could Sol be able to dispatch to Terra and Luna via this to optimise token usage?

KVCacheStore LLC 的头像
KVCacheStore LLC1 个月前

I'm a contributor :)

Haya Innovator 的头像
Haya Innovator1 个月前

Exactly the kind of routing layer enterprise agents need. I separate complex reasoning from high volume execution across my digital health stacks. Nemotron Lightning is ideal for those inference steps.

安叫兽|Bird🕊️ 🔶 BNB 的头像
安叫兽|Bird🕊️ 🔶 BNB1 个月前

按任务难度分配模型,确实比全程堆大模型省得多。

Pixel 的头像
Pixel1 个月前

routing is the missing layer. frontier for thinking, Lightning for volume. this is how agent stacks should work

相关视频