Loading video...

Video Failed to Load

Go Home

Finally, an OpenRouter for agent harnesses! (including System One by Jev) Devs just open-sourced a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 9 more...

361,933 views • 1 month ago •via X (Twitter)

34 Comments

Jatin Garg's profile picture
Jatin Garg1 month ago

OpenRouter works because all the models behind it take the same shape — text in, text out. Agent harnesses have different state, tool signatures, and session models. How does a unified interface handle that?

Akmal Makhmudov's profile picture
Akmal Makhmudov1 month ago

I only run one harness for my own build, Claude Code, so I've never hit the switching-cost pain this solves directly. for someone already committed to one harness, is the real win here A/B testing models across harnesses, or something else?

Yev Mura's profile picture
Yev Mura1 month ago

Useful layer. Separate itch on my side: once Codex / Claude Code / etc are installed they still rubber-stamp themselves. I built consilium so the hub agent can `consult` a different-provider CLI for a second opinion, or run a council that verifies every file:line finding.

Labangram Photography's profile picture
Labangram Photography1 month ago

The hard part seems to be semantic parity: session resume, streamed tool events, and cancellation need identical guarantees across harnesses. A conformance suite covering those cases would make UHP much more useful than an adapter layer.

TechP's profile picture
TechP1 month ago

This could make building with multiple AI agents much simpler. One interface, multiple harnesses.

Posterior's profile picture
Posterior1 month ago

What would be really cool is if the router automatically chooses the correct harness for a given task.

Kero Dewto's profile picture
Kero Dewto1 month ago

Interesting! I’ll try it out for mobile development and then share my hands-on experience on my page

Kizuno18's profile picture
Kizuno181 month ago

standardizing the harness layer is the missing piece. in our autonomous pipeline targeting brazil, we don't bind models to tasks directly. the harness runs deterministic python stages and invokes external harnesses only when schema gates fail. harness routing > model routing

Hussain Hashim | Building SundayBack's profile picture
Hussain Hashim | Building SundayBack1 month ago

@akshay_pachaar that's a game-changer for devs dealing with multiple harnesses! simplifies the workflow like crazy. really makes you think about how much time we waste on integrations.

Chris Izatt's profile picture
Chris Izatt1 month ago

Yoooo lemme finish up TaskWraith so it qualifies 🥲

BTCaveman.'s profile picture
BTCaveman.1 month ago

OM >

catman's profile picture
catman1 month ago

The unified interface is the strongest part, but harness routing is not quite equivalent to model routing: harnesses carry different state, tool semantics, and failure modes. UHP can normalize the plumbing, not erase those behavioral differences.

cit1z3n's profile picture
cit1z3n1 month ago

routing models is easy. routing harnesses is the part people pay for twice.

shaun's profile picture
shaun1 month ago

one harness already needs a babysitter. now i can route between five lol

Salise's profile picture
Salise1 month ago

the idea of running multiple harnesses like Codex and Claude under one interface is really cool, should save a lot of time

Zam's profile picture
Zam1 month ago

A shared harness interface is useful only if it standardizes the ugly parts too, especially cancellation, state handoff, and failure recovery across sessions.

saietta's profile picture
saietta1 month ago

model routing works because the contract is thin -- messages in, tokens out. harness routing means normalizing side effects: how each one sandboxes shell access, what a cancellation leaves mid-file-write, when a permission prompt blocks vs auto-approves. that's where it leaks first.

EDDY VU's profile picture
EDDY VU1 month ago

Having a clean abstraction layer to benchmark different harnesses against the exact same task suite is huge.

ShadowAguy's profile picture
ShadowAguy1 month ago

Unified interface sounds useful, but wondering how you handle the different prompt/response formats across Codex, Claude Code, and DeepSeek? Does the abstraction leak when one tool expects JSON while another wants raw text?

Later's profile picture
Later1 month ago

Curious how you measured harness-to-harness overhead — same task, same model, what’s the extra latency and tokens just from the unified protocol versus talking to Claude Code or Codex directly?

DeDi's profile picture
DeDi1 month ago

专为代理框架设计,UHP统一会话流式取消这类脏活实现

Later's profile picture
Later1 month ago

Unifying the harness interface is useful, but did anyone run the same task set across Codex / Claude Code / Jev and report tokens per solved task plus idle turns?

kuzzo's profile picture
kuzzo1 month ago

We already have @omnigent_ai, you’re overlooking this…

Arbaz's profile picture
Arbaz1 month ago

harness switcher is nice. finding one that barely drains is better

techa's profile picture
techa1 month ago

the agent wars are just starting and standardizing the harness layer is already table stakes, whoever owns that interface wins.

Soni's profile picture
Soni1 month ago

Standardizing permissions and sessions sounds clean until two runtimes disagree on the schema. Still babysitting, just one level higher up.

Alex | RouteAPI's profile picture
Alex | RouteAPI1 month ago

A common protocol gets you portability. State and tool behavior decide whether the switch is actually painless. Are you using more than one coding harness today?

Adam · Arcyton's profile picture
Adam · Arcyton1 month ago

One interface across harnesses is useful mostly for comparison. The part worth normalising along with the calls is failure: each harness reports a failed tool step differently, and some report it as a normal answer. Does the layer unify errors, or pass them through?

Sophia Data Queen's profile picture
Sophia Data Queen1 month ago

One interface for the harness, not just the model.

Gregor's profile picture
Gregor1 month ago

not sure the OpenRouter analogy holds. OpenRouter works because models share a shape. harness behavior is the opinionated part, and a wrapper flattens exactly that. does it preserve Jev's context-carry or does that disappear?

Saeed Ahmed's profile picture
Saeed Ahmed1 month ago

Under one harness interface, what breaks first when you swap Codex for Claude Code: permissions, tools, or memory?

JSCC | Nasdaq · AI's profile picture
JSCC | Nasdaq · AI1 month ago

Unified Harness Protocol can list Codex. Sessions and cancellation still have to work across every harness.

Sebastiano Mandalà's profile picture
Sebastiano Mandalà1 month ago

I honestly start to be fed up about these hype driven, AI written tools and articles that add complexity instead of value.

Max Bevza's profile picture
Max Bevza1 month ago

this is actually massive for agent infra

Related Videos

Harness Engineering 2.0 is here! We benchmark models all the time but the harness running the model can dramatically improve the result, cost, and execution time too. And finally, devs just open-sourced Harness Arena, where you can test the same task across multiple harness and model combinations side by side. You provide one task and then run it across several model x harness configs that you want to test. Every config receives the same prompt, files, tools, skills, and evaluation checks. Harness Arena then returns: - total cost - execution time - whether the task passed - files and artifacts produced If you want to try it yourself, it is implemented within the open-source HarnessRouter project. Here's the repo: (don't forget to star it ⭐ ) HarnessRouter is a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 25 more agent harnesses In Harness Arena, the cheapest run does not automatically win. A config must complete the task correctly first. Cost and execution time are compared only among the configurations that pass. Here's the result from one Harness Arena test: - Hermes + GPT-5.2: 5/5 successful runs using 0.47 credits - Claude Code + Opus 4.8: 3/5 successful runs using 223 credits That is around 474x difference in credits, while the more expensive configuration also failed two runs. You can keep the model fixed to measure how much the harness changes the result. Or vary both to find the best harness and model pairing for that task. This helps answer practical questions such as: - Should this task run on Codex or Claude? - Can a cheaper config still pass every check? - Which setup is best to handle this workload? Once you find the best config, you can run future tasks through it using the same Unified Harness Protocol (UHP) interface for sessions, streaming, files, artifacts, cancellation, and failures. So you are no longer choosing an agent stack based only on a model leaderboard. Instead, you can benchmark the complete runtime on the task your product actually needs to solve. To dive deeper, my co-founder wrote an article explaining why model routing is different from harness routing, how UHP works, and what supporting multiple agent runtimes involves. It also covers the local setup, a working request, and how sessions and files move through the system. Read it below.

Avi Chawla

30,196 views • 2 days ago

Insane Grok Grok Bot upgrade! Finally, you can connect Grok Bot to different agent harnesses and run tasks through their native runtimes. Devs just open-sourced HarnessRouter, the infrastructure layer that lets Grok Bot run tasks across: - Codex - Hermes - Claude Code - DeepSeek Harness - System One, powered by Jev - Pi, and 20 more GitHub repo: (don’t forget to star it ⭐) With HarnessRouter, each external specialist gets to use its own harness, model, tools, skills, and agent loop while Grok coordinates the project from one conversation. I tested this by asking Grok Bot to turn a support-ticket CSV into an interactive dashboard. Grok Bot assigned the analysis to DeepSeek Harness with Claude Sonnet 5.5, passed the output to Codex with GPT-5.5, and checked the finished dashboard in its browser. This differs from simply creating more Bots. These workers are not additional Grok Bots, and Grok Bot itself does not switch harnesses. Instead, it remains the coordinator while the delegated tasks run inside separate HarnessRouter sessions with the harness of your choice. So for another task, you can use Claude Code, Hermes, Pi, etc., without requiring a separate integration for task execution, sessions, streaming, and generated files. HarnessRouter standardizes all those operations through the Unified Harness Protocol (UHP). UHP handles sessions, streaming, files, cancellation, and failures through the same interface, regardless of which harness runs the task. I shared the GitHub repo above. And if you want to dive deeper into Grok Bot, I wrote about it in full in a masterclass, including the shared computer, memory, skills, routines, and the macOS setup. Read it below.

Avi Chawla

137,148 views • 13 days ago

Another insane Jev use case! Jev is making it dramatically cheaper to evaluate what actually happened inside an agent run. And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses: - Claude Code - Codex - Cursor - OpenCode, and 20+ more Beacon by Asymptote Labs continuously captures your agent history across harnesses and uses Jev to identify which runs are actually worth learning from. It then turns the highest-signal workflows, corrections, and debugging patterns into reusable skills. GitHub repo: (don’t forget to star it ⭐ ) Beacon preserves the complete session history. But preserving a run and learning from it are two different things. Most coding-agent sessions contain routine exploration, failed commands, and fixes that only apply to one task. The trace can remain available for inspection without turning every detail into guidance for future agents. Jev scores each run for evidence, reuse potential, and human correction signals. An application policy then decides whether to promote, review, or discard it. The recording shows this in action. Claude receives a coding task, modifies the implementation, and runs the tests. I then provide an edge-case correction, so Claude updates the code and adds regression coverage. Beacon automatically captures the complete session. Jev evaluates whether the correction contains a reusable engineering lesson. Once approved, that lesson becomes available to other coding agents working on the project. Since it works across harnesses: - Claude Code sessions can teach Codex. - Cursor debugging can improve OpenCode. So a problem solved by one agent should not need to be learned from scratch by another. If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally. Read it below.

Avi Chawla

293,860 views • 1 month ago

Another insane Jev use case! Jev makes it incredibly cheap to evaluate and classify agent runs at scale. And finally, someone open-sourced a self-improving memory layer that can put that capability to work across agent harnesses. It turns your agent sessions into a compounding knowledge layer, where every successful run can make future agents smarter across: - Codex - Claude Code - Cursor - OpenCode and 20+ more Beacon by Asymptote Labs continuously builds a shared history across your agent harnesses and uses Jev to identify the runs worth learning from. It then turns the best workflows, corrections, and debugging patterns into reusable skills. GitHub repo: (don’t forget to star it ⭐) Most agent runs are messy. They contain exploration, failed commands, dead ends, and one-off fixes that should never become permanent memory. So Beacon preserves the full session history, while Jev helps decide what should be promoted, reviewed, or discarded. The recording below shows this in action. Beacon found 579 sessions across 5 coding-agent harnesses and normalized them into one consistent history. From there, Jev surfaces the lessons worth keeping and makes them available across your agent stack. - A pattern learned in Cursor can carry into OpenCode. - A lesson from Claude Code can improve the next Codex run. Every successful run adds to the shared knowledge layer, making future agents smarter. If you want to dive deeper into Jev, I also wrote a breakdown of how it works. The article is quoted below.

Akshay 🚀

121,058 views • 1 month ago

Another insane way to use Jev: Jev makes it dramatically cheaper to identify which corrections and trajectories from an agent run are reusable across agents. And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses: - Claude Code - Codex - Cursor - OpenCode - Hermes, and 20+ more Beacon by Asymptote Labs continuously captures agent sessions across harnesses and stores their traces in a shared index. I used it with Jev to build a live cross-agent memory workflow. Beacon captures each run as it happens across all harnesses on my machine. Then Jev evaluates whether the trace contains a reusable engineering lesson, and the approved lesson becomes available to the next agent. GitHub repo: (don't forget to star it ⭐) Preserving an agent run and learning from it are two different problems. Most traces contain file reads, failed commands, routine exploration, and implementation details that only apply to one task. Passing the complete transcript to another agent adds context without identifying what matters. In this workflow, one agent never receives another agent's raw transcript. It receives only the specific engineering lesson produced from the evaluated trace. A correction made in one agent can then prevent the same mistake when another agent encounters a similar problem. The recording shows the complete workflow I built. If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally. Read it below.

Avi Chawla

70,794 views • 16 days ago

Finally, an open-source runtime security layer for your agent harnesses. AI agents can call tools, run shell commands, modify files, and interact with production systems. But when something goes wrong, teams often have to reconstruct what the agent actually did from scattered logs after the fact. Agent Beacon is built to change that. It runs locally and records agent activity as it happens, including: → Tool calls → Shell commands → File changes → Approval decisions → Session and harness context The useful part is that it normalizes all of this into the same event format across 23+ agent harnesses. So instead of writing different detection logic for Claude Code, Codex, or another harness, security teams can reason about the underlying action itself. A command executed is a command executed, regardless of which harness produced it. Beacon also records how confidently an event was captured. An action can be directly observed from the runtime or inferred from indirect evidence. That matters when you start writing security rules against this data. For example, you can detect when an agent reads an environment variable, modifies a sensitive file, executes a suspicious command, or performs an action without the expected approval. And the detection happens while the session is still unfolding, not days later during incident reconstruction. Everything runs locally by default. You can inspect sessions through the dashboard, write your own detection rules, or forward the same normalized events to tools like Splunk, Datadog, Elastic, Sentinel, or CrowdStrike. Beacon GitHub: (don't forget to star 🌟) I also wrote a detailed article on the same, covering how important runtime security is and how to build it for your agent harnesses. The article is quoted below.

Akshay 🚀

27,859 views • 1 month ago

run agent harnesses 100% private & offline. (no token costs, no API keys, 100% open-source) your agent runs locally. the model doesn't. every prompt, every file, and every secret still leaves your machine before the agent does anything with it. Magnitude fixes that. it's an open source inference server that runs models on your own hardware and plugs into the coding agent you already use. setup is one command. it profiles your machine, measures the memory bandwidth that sets your token rate, and hands back complete configurations instead of a list of models. each one names a model, a compression level, a context size, and a speed range you can expect. pick one and start working. it doesn't replace your harness. setup asks which one you want and writes that config for you. Pi, OpenCode, Claude Code, Codex, and Cline all work, and there's a built-in one tuned for local models if you don't have a harness yet. that one uses your shell, edits files, and runs scripts out of the box. add skills and it handles Excel, PowerPoint, PDFs, or Chrome. everyday work it covers: → analyze sensitive data → manage private notes → review code and logs → search and organize files → build docs or slides Apache 2.0. no rate limits, and nothing leaves the machine. 𝗻𝗽𝗺 𝗶 -𝗴 @𝗺𝗮𝗴𝗻𝗶𝘁𝘂𝗱𝗲𝗱𝗲𝘃/𝗰𝗹𝗶 the repo is here: (don't forget to star 🌟) i wrote the full breakdown of why picking the configuration is the hard part. the article is quoted below.

Akshay 🚀

56,499 views • 2 months ago