Loading video...

Video Failed to Load

Go Home

Introducing Unharnessed, a new generation of harness. One tool: a Python REPL. Designed for the next generation of models. On Terminal-Bench 4.0, Unharnessed achieves a new state-of-the-art result.

115,311 views • 1 day ago •via X (Twitter)

44 Comments

Rayane's profile picture
Rayane1 day ago

With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19. The model is the same, only the harness changes. You can read every turn of the run here:

Rayane's profile picture
Rayane1 day ago

If you watch the latest models work, they use the predefined tools less and less. They do most of the job in Python, through Bash. If that's what the model wants to do, we might as well give it the best version of it: one tool, a persistent Python REPL, where its variables and functions stay alive between calls. So instead of one call per action, the model writes a script that reads, searches, edits and checks in a single call. For comparison, Copilot hands it 48 tools, Claude Code 46, Codex 31.

Rayane's profile picture
Rayane1 day ago

Unharnessed isn't just for code. This paradigm beats the classic harness across the board: 3D, maths, data analysis, science and more. Here it is on a 3D model in Three.js, same prompt and same model as Claude Code: 94 turns, 65 minutes and $14.45, against 102 turns, 72 minutes and $21.67.

Rayane's profile picture
Rayane1 day ago

It's free and open source. You sign in with the subscription you already pay for (Claude, Codex, GitHub Copilot, Google AI or Grok), so there's no API key to set up. Everything here :

Rayane's profile picture
Rayane1 day ago

*only mac for now, Windows support and I Linux soon! Next week

Mo's profile picture
Mo1 day ago

Every few weeks, someone rediscovers prime-agent from @PrimeIntellect

Rayane's profile picture
Rayane1 day ago

@PrimeIntellect Its amazing !

kay's profile picture
kay1 day ago

seems familiar

Rayane's profile picture
Rayane1 day ago

Yep but it doesnt save the python variables for the agent

NtTestAlert's profile picture
NtTestAlert1 day ago

Population of accidentally wiped drives increases.

Priyank's profile picture
Priyank1 day ago

I am guessing this has no guardrails ?

PunishedRobocop's profile picture
PunishedRobocop1 day ago

Don’t claude ToS forbid you from using other harnesses out of CC under sub? We should start comparing subs costs vs api costs Using whatever lighter harnesses that would force API use (ToS) means anyway 10x and more cost for claude usage vs same on sub

falistos's profile picture
falistos1 day ago

Bravo, mais je vois que c’est un fork de Prime Agent, qu’apporte t-il de plus ?

falistos's profile picture
falistos1 day ago

Je vois, interessant !

Jeffrey A.'s profile picture
Jeffrey A.1 day ago

Un seul outil REPL à la place d'une pile de tools, le contexte doit respirer. Ça tient sur des tâches longues ?

otter's profile picture
otter1 day ago

ahead of the game, models will have functionality baked in.

pratham's profile picture
pratham1 day ago

The video looks really good. How did you make it?

Rayane's profile picture
Rayane1 day ago

Hey, fable 5.2 without any framework

pratham's profile picture
pratham1 day ago

Can we see the prompt? 👀

Rayane's profile picture
Rayane1 day ago

Just made a video about X topic haha withb3d Motion nothing more.

pratham's profile picture
pratham1 day ago

Crazy.

Max's profile picture
Max1 day ago

@delusionalsilex La ptite vidéo bien propre

Amy · fireply.ai's profile picture
Amy · fireply.ai1 day ago

python repl only. less to break, i like that

Aditya's profile picture
Aditya1 day ago

Interesting, I was looking into this, I think there are much better implementations out there that involve repls or 1 tool that calls others, just has to be built.

Skinoz's profile picture
Skinoz1 day ago

Quel est la différence avec prime agent ?

Skinoz's profile picture
Skinoz1 day ago

Nice je vais tester ça. Je te donnerais des nouvelles. Je l’utilise tous les jours. Je me doutais que tu voulais aborder la même philosophie. Je te ferais un retour par MP

Dan's profile picture
Dan1 day ago

What is your sound design pack? 🤤

Elias's profile picture
Elias1 day ago

a python repl as the only tool is bold. kinda like it

Kesha | ▶ ■ ⏻'s profile picture
Kesha | ▶ ■ ⏻1 day ago

I will try it. The promise is interesting, congrats to get your product out there! I am interested also by what @theo would think about it?

Zak 🦈 (e/acc)'s profile picture
Zak 🦈 (e/acc)1 day ago

Great work Rayane, i'll test that 👌🏼

Syaoran's profile picture
Syaoran1 day ago

Sinew 2.0

otter's profile picture
otter1 day ago

U is giving ubiquity

A.W.E.S.O.M.-O 4000's profile picture
A.W.E.S.O.M.-O 40001 day ago

Stripping the harness down to one tool is a bold design choice.

John Rood's profile picture
John Rood1 day ago

one tool is the right bet. the catch is that all that value lives as variables inside one process, so a crash at turn 80 makes the model rebuild state it already had. a persistent repl is only persistent while the process is.

Sam's profile picture
Sam1 day ago

this is so interesting, @theo your take on this?

Shivam Gupta's profile picture
Shivam Gupta1 day ago

The recovery case is interesting here: a script edits three files, then fails on the fourth action. What does the next turn know has already happened? Persistent variables help; an equally clear record of completed side effects would make the one-tool design much easier to trust.

Max Champoux's profile picture
Max Champoux1 day ago

Super interesting, will try!

Hugo's profile picture
Hugo1 day ago

@ZakShark Insane job, will definitely give it a try

@alexdolbun's profile picture
@alexdolbun1 day ago

Looks interesting

Mathis Dupuy's profile picture
Mathis Dupuy1 day ago

I love the idea of letting the model building it’s own tools. But what if you need to redo a task ? Should you expect it to find back the same trajectory it did before from ex nihilo ?

Max 🇺🇸's profile picture
Max 🇺🇸1 day ago

So it's Prime Agent?

Suhaan's profile picture
Suhaan1 day ago

interesting idea! btw cleanest site i have seen in a while

سالب ألف اورا's profile picture
سالب ألف اورا1 day ago

I want this for powershell

Dinesh Yadav's profile picture
Dinesh Yadav1 day ago

always heard that claude models perform better on other harnesses than their own , will check out on this !

Related Videos