Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Finally, an OpenRouter for agent harnesses! (including System One by Jev) Devs just open-sourced a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 9 more...

361,933 Aufrufe • vor 1 Monat •via X (Twitter)

34 Kommentare

Profilbild von Jatin Garg
Jatin Gargvor 1 Monat

OpenRouter works because all the models behind it take the same shape — text in, text out. Agent harnesses have different state, tool signatures, and session models. How does a unified interface handle that?

Profilbild von Akmal Makhmudov
Akmal Makhmudovvor 1 Monat

I only run one harness for my own build, Claude Code, so I've never hit the switching-cost pain this solves directly. for someone already committed to one harness, is the real win here A/B testing models across harnesses, or something else?

Profilbild von Yev Mura
Yev Muravor 1 Monat

Useful layer. Separate itch on my side: once Codex / Claude Code / etc are installed they still rubber-stamp themselves. I built consilium so the hub agent can `consult` a different-provider CLI for a second opinion, or run a council that verifies every file:line finding.

Profilbild von Labangram Photography
Labangram Photographyvor 1 Monat

The hard part seems to be semantic parity: session resume, streamed tool events, and cancellation need identical guarantees across harnesses. A conformance suite covering those cases would make UHP much more useful than an adapter layer.

Profilbild von TechP
TechPvor 1 Monat

This could make building with multiple AI agents much simpler. One interface, multiple harnesses.

Profilbild von Posterior
Posteriorvor 1 Monat

What would be really cool is if the router automatically chooses the correct harness for a given task.

Profilbild von Kero Dewto
Kero Dewtovor 1 Monat

Interesting! I’ll try it out for mobile development and then share my hands-on experience on my page

Profilbild von Kizuno18
Kizuno18vor 1 Monat

standardizing the harness layer is the missing piece. in our autonomous pipeline targeting brazil, we don't bind models to tasks directly. the harness runs deterministic python stages and invokes external harnesses only when schema gates fail. harness routing > model routing

Profilbild von Hussain Hashim | Building SundayBack
Hussain Hashim | Building SundayBackvor 1 Monat

@akshay_pachaar that's a game-changer for devs dealing with multiple harnesses! simplifies the workflow like crazy. really makes you think about how much time we waste on integrations.

Profilbild von Chris Izatt
Chris Izattvor 1 Monat

Yoooo lemme finish up TaskWraith so it qualifies 🥲

Profilbild von BTCaveman.
BTCaveman.vor 1 Monat

OM >

Profilbild von catman
catmanvor 1 Monat

The unified interface is the strongest part, but harness routing is not quite equivalent to model routing: harnesses carry different state, tool semantics, and failure modes. UHP can normalize the plumbing, not erase those behavioral differences.

Profilbild von cit1z3n
cit1z3nvor 1 Monat

routing models is easy. routing harnesses is the part people pay for twice.

Profilbild von shaun
shaunvor 1 Monat

one harness already needs a babysitter. now i can route between five lol

Profilbild von Salise
Salisevor 1 Monat

the idea of running multiple harnesses like Codex and Claude under one interface is really cool, should save a lot of time

Profilbild von Zam
Zamvor 1 Monat

A shared harness interface is useful only if it standardizes the ugly parts too, especially cancellation, state handoff, and failure recovery across sessions.

Profilbild von saietta
saiettavor 1 Monat

model routing works because the contract is thin -- messages in, tokens out. harness routing means normalizing side effects: how each one sandboxes shell access, what a cancellation leaves mid-file-write, when a permission prompt blocks vs auto-approves. that's where it leaks first.

Profilbild von EDDY VU
EDDY VUvor 1 Monat

Having a clean abstraction layer to benchmark different harnesses against the exact same task suite is huge.

Profilbild von ShadowAguy
ShadowAguyvor 1 Monat

Unified interface sounds useful, but wondering how you handle the different prompt/response formats across Codex, Claude Code, and DeepSeek? Does the abstraction leak when one tool expects JSON while another wants raw text?

Profilbild von Later
Latervor 1 Monat

Curious how you measured harness-to-harness overhead — same task, same model, what’s the extra latency and tokens just from the unified protocol versus talking to Claude Code or Codex directly?

Profilbild von DeDi
DeDivor 1 Monat

专为代理框架设计,UHP统一会话流式取消这类脏活实现

Profilbild von Later
Latervor 1 Monat

Unifying the harness interface is useful, but did anyone run the same task set across Codex / Claude Code / Jev and report tokens per solved task plus idle turns?

Profilbild von kuzzo
kuzzovor 1 Monat

We already have @omnigent_ai, you’re overlooking this…

Profilbild von Arbaz
Arbazvor 1 Monat

harness switcher is nice. finding one that barely drains is better

Profilbild von techa
techavor 1 Monat

the agent wars are just starting and standardizing the harness layer is already table stakes, whoever owns that interface wins.

Profilbild von Soni
Sonivor 1 Monat

Standardizing permissions and sessions sounds clean until two runtimes disagree on the schema. Still babysitting, just one level higher up.

Profilbild von Alex | RouteAPI
Alex | RouteAPIvor 1 Monat

A common protocol gets you portability. State and tool behavior decide whether the switch is actually painless. Are you using more than one coding harness today?

Profilbild von Adam · Arcyton
Adam · Arcytonvor 1 Monat

One interface across harnesses is useful mostly for comparison. The part worth normalising along with the calls is failure: each harness reports a failed tool step differently, and some report it as a normal answer. Does the layer unify errors, or pass them through?

Profilbild von Sophia Data Queen
Sophia Data Queenvor 1 Monat

One interface for the harness, not just the model.

Profilbild von Gregor
Gregorvor 1 Monat

not sure the OpenRouter analogy holds. OpenRouter works because models share a shape. harness behavior is the opinionated part, and a wrapper flattens exactly that. does it preserve Jev's context-carry or does that disappear?

Profilbild von Saeed Ahmed
Saeed Ahmedvor 1 Monat

Under one harness interface, what breaks first when you swap Codex for Claude Code: permissions, tools, or memory?

Profilbild von JSCC | Nasdaq · AI
JSCC | Nasdaq · AIvor 1 Monat

Unified Harness Protocol can list Codex. Sessions and cancellation still have to work across every harness.

Profilbild von Sebastiano Mandalà
Sebastiano Mandalàvor 1 Monat

I honestly start to be fed up about these hype driven, AI written tools and articles that add complexity instead of value.

Profilbild von Max Bevza
Max Bevzavor 1 Monat

this is actually massive for agent infra

Ähnliche Videos

Harness Engineering 2.0 is here! We benchmark models all the time but the harness running the model can dramatically improve the result, cost, and execution time too. And finally, devs just open-sourced Harness Arena, where you can test the same task across multiple harness and model combinations side by side. You provide one task and then run it across several model x harness configs that you want to test. Every config receives the same prompt, files, tools, skills, and evaluation checks. Harness Arena then returns: - total cost - execution time - whether the task passed - files and artifacts produced If you want to try it yourself, it is implemented within the open-source HarnessRouter project. Here's the repo: (don't forget to star it ⭐ ) HarnessRouter is a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 25 more agent harnesses In Harness Arena, the cheapest run does not automatically win. A config must complete the task correctly first. Cost and execution time are compared only among the configurations that pass. Here's the result from one Harness Arena test: - Hermes + GPT-5.2: 5/5 successful runs using 0.47 credits - Claude Code + Opus 4.8: 3/5 successful runs using 223 credits That is around 474x difference in credits, while the more expensive configuration also failed two runs. You can keep the model fixed to measure how much the harness changes the result. Or vary both to find the best harness and model pairing for that task. This helps answer practical questions such as: - Should this task run on Codex or Claude? - Can a cheaper config still pass every check? - Which setup is best to handle this workload? Once you find the best config, you can run future tasks through it using the same Unified Harness Protocol (UHP) interface for sessions, streaming, files, artifacts, cancellation, and failures. So you are no longer choosing an agent stack based only on a model leaderboard. Instead, you can benchmark the complete runtime on the task your product actually needs to solve. To dive deeper, my co-founder wrote an article explaining why model routing is different from harness routing, how UHP works, and what supporting multiple agent runtimes involves. It also covers the local setup, a working request, and how sessions and files move through the system. Read it below.

Avi Chawla

30,196 Aufrufe • vor 2 Tagen

Insane Grok Grok Bot upgrade! Finally, you can connect Grok Bot to different agent harnesses and run tasks through their native runtimes. Devs just open-sourced HarnessRouter, the infrastructure layer that lets Grok Bot run tasks across: - Codex - Hermes - Claude Code - DeepSeek Harness - System One, powered by Jev - Pi, and 20 more GitHub repo: (don’t forget to star it ⭐) With HarnessRouter, each external specialist gets to use its own harness, model, tools, skills, and agent loop while Grok coordinates the project from one conversation. I tested this by asking Grok Bot to turn a support-ticket CSV into an interactive dashboard. Grok Bot assigned the analysis to DeepSeek Harness with Claude Sonnet 5.5, passed the output to Codex with GPT-5.5, and checked the finished dashboard in its browser. This differs from simply creating more Bots. These workers are not additional Grok Bots, and Grok Bot itself does not switch harnesses. Instead, it remains the coordinator while the delegated tasks run inside separate HarnessRouter sessions with the harness of your choice. So for another task, you can use Claude Code, Hermes, Pi, etc., without requiring a separate integration for task execution, sessions, streaming, and generated files. HarnessRouter standardizes all those operations through the Unified Harness Protocol (UHP). UHP handles sessions, streaming, files, cancellation, and failures through the same interface, regardless of which harness runs the task. I shared the GitHub repo above. And if you want to dive deeper into Grok Bot, I wrote about it in full in a masterclass, including the shared computer, memory, skills, routines, and the macOS setup. Read it below.

Avi Chawla

137,148 Aufrufe • vor 13 Tagen

Another insane Jev use case! Jev is making it dramatically cheaper to evaluate what actually happened inside an agent run. And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses: - Claude Code - Codex - Cursor - OpenCode, and 20+ more Beacon by Asymptote Labs continuously captures your agent history across harnesses and uses Jev to identify which runs are actually worth learning from. It then turns the highest-signal workflows, corrections, and debugging patterns into reusable skills. GitHub repo: (don’t forget to star it ⭐ ) Beacon preserves the complete session history. But preserving a run and learning from it are two different things. Most coding-agent sessions contain routine exploration, failed commands, and fixes that only apply to one task. The trace can remain available for inspection without turning every detail into guidance for future agents. Jev scores each run for evidence, reuse potential, and human correction signals. An application policy then decides whether to promote, review, or discard it. The recording shows this in action. Claude receives a coding task, modifies the implementation, and runs the tests. I then provide an edge-case correction, so Claude updates the code and adds regression coverage. Beacon automatically captures the complete session. Jev evaluates whether the correction contains a reusable engineering lesson. Once approved, that lesson becomes available to other coding agents working on the project. Since it works across harnesses: - Claude Code sessions can teach Codex. - Cursor debugging can improve OpenCode. So a problem solved by one agent should not need to be learned from scratch by another. If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally. Read it below.

Avi Chawla

293,860 Aufrufe • vor 1 Monat

Another insane Jev use case! Jev makes it incredibly cheap to evaluate and classify agent runs at scale. And finally, someone open-sourced a self-improving memory layer that can put that capability to work across agent harnesses. It turns your agent sessions into a compounding knowledge layer, where every successful run can make future agents smarter across: - Codex - Claude Code - Cursor - OpenCode and 20+ more Beacon by Asymptote Labs continuously builds a shared history across your agent harnesses and uses Jev to identify the runs worth learning from. It then turns the best workflows, corrections, and debugging patterns into reusable skills. GitHub repo: (don’t forget to star it ⭐) Most agent runs are messy. They contain exploration, failed commands, dead ends, and one-off fixes that should never become permanent memory. So Beacon preserves the full session history, while Jev helps decide what should be promoted, reviewed, or discarded. The recording below shows this in action. Beacon found 579 sessions across 5 coding-agent harnesses and normalized them into one consistent history. From there, Jev surfaces the lessons worth keeping and makes them available across your agent stack. - A pattern learned in Cursor can carry into OpenCode. - A lesson from Claude Code can improve the next Codex run. Every successful run adds to the shared knowledge layer, making future agents smarter. If you want to dive deeper into Jev, I also wrote a breakdown of how it works. The article is quoted below.

Akshay 🚀

121,058 Aufrufe • vor 1 Monat

Another insane way to use Jev: Jev makes it dramatically cheaper to identify which corrections and trajectories from an agent run are reusable across agents. And finally, someone open-sourced a self-improving memory layer that can put that signal to work across agent harnesses: - Claude Code - Codex - Cursor - OpenCode - Hermes, and 20+ more Beacon by Asymptote Labs continuously captures agent sessions across harnesses and stores their traces in a shared index. I used it with Jev to build a live cross-agent memory workflow. Beacon captures each run as it happens across all harnesses on my machine. Then Jev evaluates whether the trace contains a reusable engineering lesson, and the approved lesson becomes available to the next agent. GitHub repo: (don't forget to star it ⭐) Preserving an agent run and learning from it are two different problems. Most traces contain file reads, failed commands, routine exploration, and implementation details that only apply to one task. Passing the complete transcript to another agent adds context without identifying what matters. In this workflow, one agent never receives another agent's raw transcript. It receives only the specific engineering lesson produced from the evaluated trace. A correction made in one agent can then prevent the same mistake when another agent encounters a similar problem. The recording shows the complete workflow I built. If you want to dive deeper into Jev, I also wrote a hands-on guide to building this Jev-style decision path with open models, entirely locally. Read it below.

Avi Chawla

70,794 Aufrufe • vor 16 Tagen

Finally, an open-source runtime security layer for your agent harnesses. AI agents can call tools, run shell commands, modify files, and interact with production systems. But when something goes wrong, teams often have to reconstruct what the agent actually did from scattered logs after the fact. Agent Beacon is built to change that. It runs locally and records agent activity as it happens, including: → Tool calls → Shell commands → File changes → Approval decisions → Session and harness context The useful part is that it normalizes all of this into the same event format across 23+ agent harnesses. So instead of writing different detection logic for Claude Code, Codex, or another harness, security teams can reason about the underlying action itself. A command executed is a command executed, regardless of which harness produced it. Beacon also records how confidently an event was captured. An action can be directly observed from the runtime or inferred from indirect evidence. That matters when you start writing security rules against this data. For example, you can detect when an agent reads an environment variable, modifies a sensitive file, executes a suspicious command, or performs an action without the expected approval. And the detection happens while the session is still unfolding, not days later during incident reconstruction. Everything runs locally by default. You can inspect sessions through the dashboard, write your own detection rules, or forward the same normalized events to tools like Splunk, Datadog, Elastic, Sentinel, or CrowdStrike. Beacon GitHub: (don't forget to star 🌟) I also wrote a detailed article on the same, covering how important runtime security is and how to build it for your agent harnesses. The article is quoted below.

Akshay 🚀

27,859 Aufrufe • vor 1 Monat

run agent harnesses 100% private & offline. (no token costs, no API keys, 100% open-source) your agent runs locally. the model doesn't. every prompt, every file, and every secret still leaves your machine before the agent does anything with it. Magnitude fixes that. it's an open source inference server that runs models on your own hardware and plugs into the coding agent you already use. setup is one command. it profiles your machine, measures the memory bandwidth that sets your token rate, and hands back complete configurations instead of a list of models. each one names a model, a compression level, a context size, and a speed range you can expect. pick one and start working. it doesn't replace your harness. setup asks which one you want and writes that config for you. Pi, OpenCode, Claude Code, Codex, and Cline all work, and there's a built-in one tuned for local models if you don't have a harness yet. that one uses your shell, edits files, and runs scripts out of the box. add skills and it handles Excel, PowerPoint, PDFs, or Chrome. everyday work it covers: → analyze sensitive data → manage private notes → review code and logs → search and organize files → build docs or slides Apache 2.0. no rate limits, and nothing leaves the machine. 𝗻𝗽𝗺 𝗶 -𝗴 @𝗺𝗮𝗴𝗻𝗶𝘁𝘂𝗱𝗲𝗱𝗲𝘃/𝗰𝗹𝗶 the repo is here: (don't forget to star 🌟) i wrote the full breakdown of why picking the configuration is the hard part. the article is quoted below.

Akshay 🚀

56,499 Aufrufe • vor 2 Monaten