Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

ICYMI: Not every step in an agent workflow needs the same model. Meet NVIDIA NeMo Switchyard, a new open-source library for model routing. Use frontier models for complex reasoning and planning, and NVIDIA Nemotron Lightning for high-volume, specialized execution.

16,629 Aufrufe • vor 1 Monat •via X (Twitter)

15 Kommentare

Profilbild von NVIDIA AI
NVIDIA AIvor 1 Monat

Learn more:

Profilbild von Joe Stevens
Joe Stevensvor 1 Monat

🕸🤖🕸

Profilbild von TerraByte AI
TerraByte AIvor 1 Monat

Geospatial search is a good routing test. A small model can handle place, date and sensor filters. Only ambiguous queries like “recent burn scars near vineyards” need the expensive model.

Profilbild von 无限未来
无限未来vor 1 Monat

你好,为什么测试你们平台的模型,几乎全部都连接失败,使用测试成功的模型也经常报错

Profilbild von REVELATOR
REVELATORvor 1 Monat

@grok exine structure closely matched modern maize pollen.

Profilbild von Alex Lee
Alex Leevor 1 Monat

This is the direction agents are heading 👀 Right model, right task, better efficiency 🚀

Profilbild von freesoul
freesoulvor 1 Monat

Looking forward to testing the escalation and prefill routers in real workflows.

Profilbild von Patch
Patchvor 1 Monat

I thought we already had model routing….?

Profilbild von Strategize Labs
Strategize Labsvor 1 Monat

Routing to the right model depending on the job size and complexity. That's how you get real cost compression and value for your bucks.

Profilbild von Gokulan Vikash
Gokulan Vikashvor 22 Tagen

Can I talk to someone from this team? Why is this not ready/useable for production workload?

Profilbild von Francesco Di Costanzo
Francesco Di Costanzovor 1 Monat

Could my @openclaw pass the message to the router which then dispatches to the right model? That would be cool (provided it works). Equally could Sol be able to dispatch to Terra and Luna via this to optimise token usage?

Profilbild von KVCacheStore LLC
KVCacheStore LLCvor 1 Monat

I'm a contributor :)

Profilbild von Haya Innovator
Haya Innovatorvor 1 Monat

Exactly the kind of routing layer enterprise agents need. I separate complex reasoning from high volume execution across my digital health stacks. Nemotron Lightning is ideal for those inference steps.

Profilbild von 安叫兽|Bird🕊️ 🔶 BNB
安叫兽|Bird🕊️ 🔶 BNBvor 1 Monat

按任务难度分配模型,确实比全程堆大模型省得多。

Profilbild von Pixel
Pixelvor 1 Monat

routing is the missing layer. frontier for thinking, Lightning for volume. this is how agent stacks should work

Ähnliche Videos