正在加载视频...
视频加载失败
Ok this is actually insane. Everyone building agents right now is doing the same expensive mistake. They let the model decide LITERALLY everything. Every check. Every gate. Every "should this proceed." All routed through the same $50/M model that's supposed to be doing the hard thinking. That's not intelligence.... show more
21,816 次观看 • 4 天前 •via X (Twitter)
10 条评论

@cyrilXBT I hit this wall too. Realized splitting tasks between specialized models saved a ton. Made handling ops much smoother.

also matters about the context on the agents too so it doesnt rot away

The real cost isn't the $50 model - it's the latency tax of routing every micro-decision through frontier compute. Why aren't builders using tool-calling for the cheap checks?

Would be useful to show which Hermes versions each plugin is tested against

preach. using $50/M models as conditional gates or json linters is why most teams burn out their cloud budget in 2 weeks. in our autonomous pipeline targeting brazil, we run strict pydantic code gates + local decision models for $0.00. save frontier tokens for actual reasoning

haiku sits on every gate

finally someone gets it right

Building cheaper agents that still hallucinate on every gate check isn't an upgrade-it's just scaling the same failure mode faster. When do you decide a human override is worth the latency?

this router setup is an absolute game changer

Caught ours burning hundreds of reasoning tokens just to decide if an output was blank. Three paragraphs of internal monologue before it finally said yes. Pure punishment for being too lazy to write an if-statement.
