正在加载视频...
视频加载失败
Jev + Opus 5.5, side by side. same agent. same task. same 60 decisions. Opus-only: $2.24 - 3m 37s Jev + Opus: $0.43 - 1m 15s the difference is who makes the small calls: which tool runs next - Jev is this output good enough - Jev is the... show more
19,565 次观看 • 16 天前 •via X (Twitter)
6 条评论

Smart routing done right

actually huge

Leave the refund rewrite on Opus. Which tool runs next, is the output good enough, and is the goal met are closed questions, so they belong on Jev with a confidence floor. I only auto-route when the top option clears that floor. Anything under it goes back to the big model instead of guessing.

i ran jev against haiku on sorting my own knowledge notes earlier this month, and across all of them haiku was ahead, about ninety eight right in a hundred against about ninety one. when i only kept the six in ten notes jev was surest about, it got every one of those right, and haiku did about as well on its own six in ten. so before sending fifty seven of sixty calls to jev, log its confidence on each one and have opus answer a sample of the same calls. if the misses sit in the low confidence ones, that's your line for when opus steps in. i wrote up the numbers here

What's the one problem you're seeing?

That cost difference really adds up
