Loading video...

Video Failed to Load

Go Home

Jev Engineering is what turns an agent stack into an actual control system and moves the expensive model out of every decision loop. and up to 193x faster and 444x cheaper in tests. the model shouldn’t decide everything. in this setup: request → structured state → Jev router →...

183,128 views • 1 month ago •via X (Twitter)

23 Comments

Morty's profile picture
Morty1 month ago

It looks wild Ricker

Ricker's profile picture
Ricker1 month ago

thanks Morty

Apex's profile picture
Apex1 month ago

This vis perfectly explains Jev Harness

Ricker's profile picture
Ricker1 month ago

exactly mate

Yarchi's profile picture
Yarchi1 month ago

decision layers that don't generate prose is a clean way to frame it

Ricker's profile picture
Ricker1 month ago

fact Yarchi

Zero's profile picture
Zero1 month ago

wow, that's wild

monokern's profile picture
monokern1 month ago

insane

Commisticholy's profile picture
Commisticholy1 month ago

This architectural shift is huge. Request -> State -> Jev fast decision -> Target Tool means 90% of router ops happen in under 50ms before touching a heavy model. Pure system design elegance.

Apo Apo 🐂🀄's profile picture
Apo Apo 🐂🀄1 month ago

Route → score → block → approve. That’s the sentence that matters. Prose models shouldn’t sit in every loop. A cheap decider plus a gate is a control system. Still needs a room the worker comes home to — keys, session, human on the last write. Jev Engineering is the reflex. @AgentOS_Tech is the desk around it.

rewind's profile picture
rewind1 month ago

Great one, mate.

Zodon Lore's profile picture
Zodon Lore1 month ago

Routing system state transitions with LLM prose is paying a high premium for latency and hallucinated control flow.

Chen's profile picture
Chen1 month ago

same. the boring part is what actually ships

Concreativy mostr's profile picture
Concreativy mostr1 month ago

очередное дерьмо

Dzerbi's profile picture
Dzerbi1 month ago

The interesting shift is treating the agent stack like a control system instead of making the model responsible for every decision. Cheap, deterministic gates can handle the routine work and reserve expensive reasoning for where it actually adds value.

Arthur Marques's profile picture
Arthur Marques1 month ago

193x faster and 444x cheaper is wild, and the fact that you measured it makes it even better. What was the baseline: a frontier model in every loop? And did accuracy on the decision layer hold up?

Tyler's profile picture
Tyler1 month ago

I loved your article btw - I'm going to read through it again but you were def the first (on my feed at least) to share anything about this. Really Solid.

shinra's profile picture
shinra1 month ago

request → state → router → cheap model → gate → tool is the control loop agents have been missing. One caveat: a cheap layer fails more quietly. Without a confidence threshold and escalation to a human or a frontier model, you just take the wrong step faster.

magsimich's profile picture
magsimich1 month ago

193x faster is seriously crazy

1Broom's profile picture
1Broom1 month ago

The architecture is right. Worth naming where 193x comes from though, that is TypeSafe running their own workflow eval. The independent number I have seen is nearer 25x across 777 judgments, still enough to change how I build. Quote the one that survives your own data.

Justin's profile picture
Justin1 month ago

Reminds me of how a pattern buffer from a Star Trek teleporter might operate. 🤪

Wallchain Community Hub's profile picture
Wallchain Community Hub1 month ago

removing LLMs from every loop is literally the only way agents scale

ZeroSequels's profile picture
ZeroSequels1 month ago

seems like the new paradigm

Related Videos

Introducing *Switch*: a *harness framework* for *decision models* like Jev I looked for this the other day and was surprised to not find anything like it You obviously cannot use a decision model like an LLM in a coding agent harness like Pi, because Jev cannot generate tool calls But what if there was a framework that "generated the tool calls" for it programmatically, and Jev only had to pick out of that finite set of choices That is what switch does. You pick a "domain" to implement the decision model in, and it provides a core API to define your state, and the functions that will derive decision model questions out of that state. Chess is a domain, as well as being a rubric judge for evals It basically standardizes what I imagine a lot of people are already vibe-coding, to an abstract interface: calling a decision-model API through multiple steps, i.e. an agent loop over finite choices Because of the finiteness of the output of a decision model, you cannot have a general pure decision model harness. Instead, you need to implement specific ones that generate the choices programmatically (or have an LLM generate the choices, but I find the former more interesting) A primary use case I have for this is use as a judge in an eval. For example, At the end of a task run that involves a bunch of documents, most people currently follow this approach: extract text out of PDF/docx/md files, and dump them right into the context But what if the visual formatting of the output is a judging criterion? Then you have to dump an image of every page in the input state. But what if you have 200 pages, and your question does not need looking at all of them? What if Jev could navigate through the haystack and find the info it needs? I have noticed that Jev is not so good at chess nor being a Decision-Model-as-a-Judge. It sucks at chess, and it does not perform well enough to replace GPT 6.1 Sol as a judge in the domain I am working for But switch is not only for Jev! It is for any decision model including the ones supported by the pi-ai package So once you can generate enough data with a better model, you should be able to pick an open source one and fine-tune it on your use case to perform better! And the model should be trained in a harness like switch's to be especially performant and cost-efficient I wanted to get this out because I find the idea very exciting, at least for benchmarking. Jev is currently not there, but decision models obviously will be there at some point, and we can take them there! There are also a lot of potential gains from picking a specific domain, and creating a looping agent that does a job for 100x cheaper! Let me know if you have any ideas, I am quite keen to try this on new domains! Repo:

Onur Solmaz

106,096 views • 10 days ago

Jev model has been causing a sensation on GitHub ever since its release, and I am going to tell you about the best repositories that nobody is talking about How does this work: browser-use/browser-use⁠ - 32,500+ stars The core web automation library that houses the Jev integration ecosystem (including ⁠jev-ultrafast⁠). It enables AI decision models to directly control web browser actions, click DOM elements, and automate complex workflows without heavy LLM latency langchain-ai/langchain⁠ - 98,500+ stars Integrates Jev as an ultra-fast model router, guardrail evaluator, and safety firewall. Jev evaluates task risk, intent, and complexity before passing execution to heavy LLMs LiteLLM/litellm⁠ - 59,200+ stars A lightweight proxy and routing library for LLMs. It features native Jev decision-model routing to classify incoming prompts and instantly direct requests to the cheapest or fastest model endpoint dify-ai/dify⁠ - 58,000+ stars An open-source LLM application development platform that incorporates Jev-style decision nodes for instant conditional branching and typed classification in multi-agent workflows vllm-project/vllm⁠ - 36,000+ stars A high-throughput LLM serving engine widely used for self-hosting custom decision-model checkpoints (such as Qwen3.5-based Jev fine-tunes) with ultra-low latency logits evaluation QwenLM/Qwen⁠ - 18,500+ stars The open base model family (Qwen3.5/3.8) used to train open-source Jev-like decision models (like Kev and RSI-Jev) powering typed probabilistic choices directly from custom model weights 🔗 You will definitely find what you need. I recommend adding this to your bookmarks

Bober_smart

20,161 views • 1 month ago