Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Introducing Unharnessed, a new generation of harness. One tool: a Python REPL. Designed for the next generation of models. On Terminal-Bench 4.0, Unharnessed achieves a new state-of-the-art result.

115,311 Aufrufe • vor 1 Tag •via X (Twitter)

44 Kommentare

Profilbild von Rayane
Rayanevor 1 Tag

With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19. The model is the same, only the harness changes. You can read every turn of the run here:

Profilbild von Rayane
Rayanevor 1 Tag

If you watch the latest models work, they use the predefined tools less and less. They do most of the job in Python, through Bash. If that's what the model wants to do, we might as well give it the best version of it: one tool, a persistent Python REPL, where its variables and functions stay alive between calls. So instead of one call per action, the model writes a script that reads, searches, edits and checks in a single call. For comparison, Copilot hands it 48 tools, Claude Code 46, Codex 31.

Profilbild von Rayane
Rayanevor 1 Tag

Unharnessed isn't just for code. This paradigm beats the classic harness across the board: 3D, maths, data analysis, science and more. Here it is on a 3D model in Three.js, same prompt and same model as Claude Code: 94 turns, 65 minutes and $14.45, against 102 turns, 72 minutes and $21.67.

Profilbild von Rayane
Rayanevor 1 Tag

It's free and open source. You sign in with the subscription you already pay for (Claude, Codex, GitHub Copilot, Google AI or Grok), so there's no API key to set up. Everything here :

Profilbild von Rayane
Rayanevor 1 Tag

*only mac for now, Windows support and I Linux soon! Next week

Profilbild von Mo
Movor 1 Tag

Every few weeks, someone rediscovers prime-agent from @PrimeIntellect

Profilbild von Rayane
Rayanevor 1 Tag

@PrimeIntellect Its amazing !

Profilbild von kay
kayvor 1 Tag

seems familiar

Profilbild von Rayane
Rayanevor 1 Tag

Yep but it doesnt save the python variables for the agent

Profilbild von NtTestAlert
NtTestAlertvor 1 Tag

Population of accidentally wiped drives increases.

Profilbild von Priyank
Priyankvor 1 Tag

I am guessing this has no guardrails ?

Profilbild von PunishedRobocop
PunishedRobocopvor 1 Tag

Don’t claude ToS forbid you from using other harnesses out of CC under sub? We should start comparing subs costs vs api costs Using whatever lighter harnesses that would force API use (ToS) means anyway 10x and more cost for claude usage vs same on sub

Profilbild von falistos
falistosvor 1 Tag

Bravo, mais je vois que c’est un fork de Prime Agent, qu’apporte t-il de plus ?

Profilbild von falistos
falistosvor 1 Tag

Je vois, interessant !

Profilbild von Jeffrey A.
Jeffrey A.vor 1 Tag

Un seul outil REPL à la place d'une pile de tools, le contexte doit respirer. Ça tient sur des tâches longues ?

Profilbild von otter
ottervor 1 Tag

ahead of the game, models will have functionality baked in.

Profilbild von pratham
prathamvor 1 Tag

The video looks really good. How did you make it?

Profilbild von Rayane
Rayanevor 1 Tag

Hey, fable 5.2 without any framework

Profilbild von pratham
prathamvor 1 Tag

Can we see the prompt? 👀

Profilbild von Rayane
Rayanevor 1 Tag

Just made a video about X topic haha withb3d Motion nothing more.

Profilbild von pratham
prathamvor 1 Tag

Crazy.

Profilbild von Max
Maxvor 1 Tag

@delusionalsilex La ptite vidéo bien propre

Profilbild von Amy · fireply.ai
Amy · fireply.aivor 1 Tag

python repl only. less to break, i like that

Profilbild von Aditya
Adityavor 1 Tag

Interesting, I was looking into this, I think there are much better implementations out there that involve repls or 1 tool that calls others, just has to be built.

Profilbild von Skinoz
Skinozvor 1 Tag

Quel est la différence avec prime agent ?

Profilbild von Skinoz
Skinozvor 1 Tag

Nice je vais tester ça. Je te donnerais des nouvelles. Je l’utilise tous les jours. Je me doutais que tu voulais aborder la même philosophie. Je te ferais un retour par MP

Profilbild von Dan
Danvor 1 Tag

What is your sound design pack? 🤤

Profilbild von Elias
Eliasvor 1 Tag

a python repl as the only tool is bold. kinda like it

Profilbild von Kesha | ▶ ■ ⏻
Kesha | ▶ ■ ⏻vor 1 Tag

I will try it. The promise is interesting, congrats to get your product out there! I am interested also by what @theo would think about it?

Profilbild von Zak 🦈 (e/acc)
Zak 🦈 (e/acc)vor 1 Tag

Great work Rayane, i'll test that 👌🏼

Profilbild von Syaoran
Syaoranvor 1 Tag

Sinew 2.0

Profilbild von otter
ottervor 1 Tag

U is giving ubiquity

Profilbild von A.W.E.S.O.M.-O 4000
A.W.E.S.O.M.-O 4000vor 1 Tag

Stripping the harness down to one tool is a bold design choice.

Profilbild von John Rood
John Roodvor 1 Tag

one tool is the right bet. the catch is that all that value lives as variables inside one process, so a crash at turn 80 makes the model rebuild state it already had. a persistent repl is only persistent while the process is.

Profilbild von Sam
Samvor 1 Tag

this is so interesting, @theo your take on this?

Profilbild von Shivam Gupta
Shivam Guptavor 1 Tag

The recovery case is interesting here: a script edits three files, then fails on the fourth action. What does the next turn know has already happened? Persistent variables help; an equally clear record of completed side effects would make the one-tool design much easier to trust.

Profilbild von Max Champoux
Max Champouxvor 1 Tag

Super interesting, will try!

Profilbild von Hugo
Hugovor 1 Tag

@ZakShark Insane job, will definitely give it a try

Profilbild von @alexdolbun
@alexdolbunvor 1 Tag

Looks interesting

Profilbild von Mathis Dupuy
Mathis Dupuyvor 1 Tag

I love the idea of letting the model building it’s own tools. But what if you need to redo a task ? Should you expect it to find back the same trajectory it did before from ex nihilo ?

Profilbild von Max 🇺🇸
Max 🇺🇸vor 1 Tag

So it's Prime Agent?

Profilbild von Suhaan
Suhaanvor 1 Tag

interesting idea! btw cleanest site i have seen in a while

Profilbild von سالب ألف اورا
سالب ألف اوراvor 1 Tag

I want this for powershell

Profilbild von Dinesh Yadav
Dinesh Yadavvor 1 Tag

always heard that claude models perform better on other harnesses than their own , will check out on this !

Ähnliche Videos