Building an agent with model router powered by Jev.

Here is full prompt that i used:

What software is this? Looks interesting.

Routing is the perfect job for Jev: one forward pass to pick the model instead of burning a full LLM call just to decide. The real win is cost. Most tasks go to cheap models and only the hard ones get escalated.

Really cool, we also built it and it’s open source! Feel free to fork/use it

A model router is usually where the agent stops being one-trick

half snark and def skill issue, buuut... my modal hero's journey

Love this

make it crawl a site and write the api client for it

Love how you tell the user, that’s cool

supercool, I'm also building one, will likely release today

i wish there was a way to reuse input cache between models though. otherwise model routing kinda still ends up being expensive

𝐀𝐮𝐭𝐨𝐦𝐚𝐭𝐢𝐜 𝐦𝐨𝐝𝐞𝐥 𝐬𝐞𝐥𝐞𝐜𝐭𝐢𝐨𝐧 𝐩𝐮𝐭𝐬 𝐜𝐨𝐬𝐭 𝐜𝐨𝐧𝐭𝐫𝐨𝐥 𝐢𝐧𝐬𝐢𝐝𝐞 𝐭𝐡𝐞 𝐚𝐠𝐞𝐧𝐭 𝐰𝐨𝐫𝐤𝐟𝐥𝐨𝐰

routing is the useful bit here. dont waste the big model on every step.

Jev showing the task labels alongside its model choice makes the routing easier to understand: you can see whether it recognized the need for web access or file creation before judging the answer.