Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Jev Engineering is what turns an agent stack into an actual control system and moves the expensive model out of every decision loop. and up to 193x faster and 444x cheaper in tests. the model shouldn’t decide everything. in this setup: request → structured state → Jev router →...

183,199 Aufrufe • vor 1 Monat •via X (Twitter)

23 Kommentare

Profilbild von Morty
Mortyvor 1 Monat

It looks wild Ricker

Profilbild von Ricker
Rickervor 1 Monat

thanks Morty

Profilbild von Apex
Apexvor 1 Monat

This vis perfectly explains Jev Harness

Profilbild von Ricker
Rickervor 1 Monat

exactly mate

Profilbild von Yarchi
Yarchivor 1 Monat

decision layers that don't generate prose is a clean way to frame it

Profilbild von Ricker
Rickervor 1 Monat

fact Yarchi

Profilbild von Zero
Zerovor 1 Monat

wow, that's wild

Profilbild von monokern
monokernvor 1 Monat

insane

Profilbild von Commisticholy
Commisticholyvor 1 Monat

This architectural shift is huge. Request -> State -> Jev fast decision -> Target Tool means 90% of router ops happen in under 50ms before touching a heavy model. Pure system design elegance.

Profilbild von Apo Apo 🐂🀄
Apo Apo 🐂🀄vor 1 Monat

Route → score → block → approve. That’s the sentence that matters. Prose models shouldn’t sit in every loop. A cheap decider plus a gate is a control system. Still needs a room the worker comes home to — keys, session, human on the last write. Jev Engineering is the reflex. @AgentOS_Tech is the desk around it.

Profilbild von rewind
rewindvor 1 Monat

Great one, mate.

Profilbild von Zodon Lore
Zodon Lorevor 1 Monat

Routing system state transitions with LLM prose is paying a high premium for latency and hallucinated control flow.

Profilbild von Chen
Chenvor 1 Monat

same. the boring part is what actually ships

Profilbild von Concreativy mostr
Concreativy mostrvor 1 Monat

очередное дерьмо

Profilbild von Dzerbi
Dzerbivor 1 Monat

The interesting shift is treating the agent stack like a control system instead of making the model responsible for every decision. Cheap, deterministic gates can handle the routine work and reserve expensive reasoning for where it actually adds value.

Profilbild von Arthur Marques
Arthur Marquesvor 1 Monat

193x faster and 444x cheaper is wild, and the fact that you measured it makes it even better. What was the baseline: a frontier model in every loop? And did accuracy on the decision layer hold up?

Profilbild von Tyler
Tylervor 1 Monat

I loved your article btw - I'm going to read through it again but you were def the first (on my feed at least) to share anything about this. Really Solid.

Profilbild von shinra
shinravor 1 Monat

request → state → router → cheap model → gate → tool is the control loop agents have been missing. One caveat: a cheap layer fails more quietly. Without a confidence threshold and escalation to a human or a frontier model, you just take the wrong step faster.

Profilbild von magsimich
magsimichvor 1 Monat

193x faster is seriously crazy

Profilbild von 1Broom
1Broomvor 1 Monat

The architecture is right. Worth naming where 193x comes from though, that is TypeSafe running their own workflow eval. The independent number I have seen is nearer 25x across 777 judgments, still enough to change how I build. Quote the one that survives your own data.

Profilbild von Justin
Justinvor 1 Monat

Reminds me of how a pattern buffer from a Star Trek teleporter might operate. 🤪

Profilbild von Wallchain Community Hub
Wallchain Community Hubvor 1 Monat

removing LLMs from every loop is literally the only way agents scale

Profilbild von ZeroSequels
ZeroSequelsvor 1 Monat

seems like the new paradigm

Ähnliche Videos

Introducing *Switch*: a *harness framework* for *decision models* like Jev I looked for this the other day and was surprised to not find anything like it You obviously cannot use a decision model like an LLM in a coding agent harness like Pi, because Jev cannot generate tool calls But what if there was a framework that "generated the tool calls" for it programmatically, and Jev only had to pick out of that finite set of choices That is what switch does. You pick a "domain" to implement the decision model in, and it provides a core API to define your state, and the functions that will derive decision model questions out of that state. Chess is a domain, as well as being a rubric judge for evals It basically standardizes what I imagine a lot of people are already vibe-coding, to an abstract interface: calling a decision-model API through multiple steps, i.e. an agent loop over finite choices Because of the finiteness of the output of a decision model, you cannot have a general pure decision model harness. Instead, you need to implement specific ones that generate the choices programmatically (or have an LLM generate the choices, but I find the former more interesting) A primary use case I have for this is use as a judge in an eval. For example, At the end of a task run that involves a bunch of documents, most people currently follow this approach: extract text out of PDF/docx/md files, and dump them right into the context But what if the visual formatting of the output is a judging criterion? Then you have to dump an image of every page in the input state. But what if you have 200 pages, and your question does not need looking at all of them? What if Jev could navigate through the haystack and find the info it needs? I have noticed that Jev is not so good at chess nor being a Decision-Model-as-a-Judge. It sucks at chess, and it does not perform well enough to replace GPT 6.1 Sol as a judge in the domain I am working for But switch is not only for Jev! It is for any decision model including the ones supported by the pi-ai package So once you can generate enough data with a better model, you should be able to pick an open source one and fine-tune it on your use case to perform better! And the model should be trained in a harness like switch's to be especially performant and cost-efficient I wanted to get this out because I find the idea very exciting, at least for benchmarking. Jev is currently not there, but decision models obviously will be there at some point, and we can take them there! There are also a lot of potential gains from picking a specific domain, and creating a looping agent that does a job for 100x cheaper! Let me know if you have any ideas, I am quite keen to try this on new domains! Repo:

Onur Solmaz

106,096 Aufrufe • vor 14 Tagen

Jev model has been causing a sensation on GitHub ever since its release, and I am going to tell you about the best repositories that nobody is talking about How does this work: browser-use/browser-use⁠ - 32,500+ stars The core web automation library that houses the Jev integration ecosystem (including ⁠jev-ultrafast⁠). It enables AI decision models to directly control web browser actions, click DOM elements, and automate complex workflows without heavy LLM latency langchain-ai/langchain⁠ - 98,500+ stars Integrates Jev as an ultra-fast model router, guardrail evaluator, and safety firewall. Jev evaluates task risk, intent, and complexity before passing execution to heavy LLMs LiteLLM/litellm⁠ - 59,200+ stars A lightweight proxy and routing library for LLMs. It features native Jev decision-model routing to classify incoming prompts and instantly direct requests to the cheapest or fastest model endpoint dify-ai/dify⁠ - 58,000+ stars An open-source LLM application development platform that incorporates Jev-style decision nodes for instant conditional branching and typed classification in multi-agent workflows vllm-project/vllm⁠ - 36,000+ stars A high-throughput LLM serving engine widely used for self-hosting custom decision-model checkpoints (such as Qwen3.5-based Jev fine-tunes) with ultra-low latency logits evaluation QwenLM/Qwen⁠ - 18,500+ stars The open base model family (Qwen3.5/3.8) used to train open-source Jev-like decision models (like Kev and RSI-Jev) powering typed probabilistic choices directly from custom model weights 🔗 You will definitely find what you need. I recommend adding this to your bookmarks

Bober_smart

20,161 Aufrufe • vor 1 Monat