正在加载视频...

视频加载失败

Introducing Unharnessed, a new generation of harness. One tool: a Python REPL. Designed for the next generation of models. On Terminal-Bench 4.0, Unharnessed achieves a new state-of-the-art result.

115,311 次观看 • 1 天前 •via X (Twitter)

44 条评论

Rayane 的头像
Rayane1 天前

With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19. The model is the same, only the harness changes. You can read every turn of the run here:

Rayane 的头像
Rayane1 天前

If you watch the latest models work, they use the predefined tools less and less. They do most of the job in Python, through Bash. If that's what the model wants to do, we might as well give it the best version of it: one tool, a persistent Python REPL, where its variables and functions stay alive between calls. So instead of one call per action, the model writes a script that reads, searches, edits and checks in a single call. For comparison, Copilot hands it 48 tools, Claude Code 46, Codex 31.

Rayane 的头像
Rayane1 天前

Unharnessed isn't just for code. This paradigm beats the classic harness across the board: 3D, maths, data analysis, science and more. Here it is on a 3D model in Three.js, same prompt and same model as Claude Code: 94 turns, 65 minutes and $14.45, against 102 turns, 72 minutes and $21.67.

Rayane 的头像
Rayane1 天前

It's free and open source. You sign in with the subscription you already pay for (Claude, Codex, GitHub Copilot, Google AI or Grok), so there's no API key to set up. Everything here :

Rayane 的头像
Rayane1 天前

*only mac for now, Windows support and I Linux soon! Next week

Mo 的头像
Mo1 天前

Every few weeks, someone rediscovers prime-agent from @PrimeIntellect

Rayane 的头像
Rayane1 天前

@PrimeIntellect Its amazing !

kay 的头像
kay1 天前

seems familiar

Rayane 的头像
Rayane1 天前

Yep but it doesnt save the python variables for the agent

NtTestAlert 的头像
NtTestAlert1 天前

Population of accidentally wiped drives increases.

Priyank 的头像
Priyank1 天前

I am guessing this has no guardrails ?

PunishedRobocop 的头像
PunishedRobocop1 天前

Don’t claude ToS forbid you from using other harnesses out of CC under sub? We should start comparing subs costs vs api costs Using whatever lighter harnesses that would force API use (ToS) means anyway 10x and more cost for claude usage vs same on sub

falistos 的头像
falistos1 天前

Bravo, mais je vois que c’est un fork de Prime Agent, qu’apporte t-il de plus ?

falistos 的头像
falistos1 天前

Je vois, interessant !

Jeffrey A. 的头像
Jeffrey A.1 天前

Un seul outil REPL à la place d'une pile de tools, le contexte doit respirer. Ça tient sur des tâches longues ?

otter 的头像
otter1 天前

ahead of the game, models will have functionality baked in.

pratham 的头像
pratham1 天前

The video looks really good. How did you make it?

Rayane 的头像
Rayane1 天前

Hey, fable 5.2 without any framework

pratham 的头像
pratham1 天前

Can we see the prompt? 👀

Rayane 的头像
Rayane1 天前

Just made a video about X topic haha withb3d Motion nothing more.

pratham 的头像
pratham1 天前

Crazy.

Max 的头像
Max1 天前

@delusionalsilex La ptite vidéo bien propre

Amy · fireply.ai 的头像
Amy · fireply.ai1 天前

python repl only. less to break, i like that

Aditya 的头像
Aditya1 天前

Interesting, I was looking into this, I think there are much better implementations out there that involve repls or 1 tool that calls others, just has to be built.

Skinoz 的头像
Skinoz1 天前

Quel est la différence avec prime agent ?

Skinoz 的头像
Skinoz1 天前

Nice je vais tester ça. Je te donnerais des nouvelles. Je l’utilise tous les jours. Je me doutais que tu voulais aborder la même philosophie. Je te ferais un retour par MP

Dan 的头像
Dan1 天前

What is your sound design pack? 🤤

Elias 的头像
Elias1 天前

a python repl as the only tool is bold. kinda like it

Kesha | ▶ ■ ⏻ 的头像
Kesha | ▶ ■ ⏻1 天前

I will try it. The promise is interesting, congrats to get your product out there! I am interested also by what @theo would think about it?

Zak 🦈 (e/acc) 的头像
Zak 🦈 (e/acc)1 天前

Great work Rayane, i'll test that 👌🏼

Syaoran 的头像
Syaoran1 天前

Sinew 2.0

otter 的头像
otter1 天前

U is giving ubiquity

A.W.E.S.O.M.-O 4000 的头像
A.W.E.S.O.M.-O 40001 天前

Stripping the harness down to one tool is a bold design choice.

John Rood 的头像
John Rood1 天前

one tool is the right bet. the catch is that all that value lives as variables inside one process, so a crash at turn 80 makes the model rebuild state it already had. a persistent repl is only persistent while the process is.

Sam 的头像
Sam1 天前

this is so interesting, @theo your take on this?

Shivam Gupta 的头像
Shivam Gupta1 天前

The recovery case is interesting here: a script edits three files, then fails on the fourth action. What does the next turn know has already happened? Persistent variables help; an equally clear record of completed side effects would make the one-tool design much easier to trust.

Max Champoux 的头像
Max Champoux1 天前

Super interesting, will try!

Hugo 的头像
Hugo1 天前

@ZakShark Insane job, will definitely give it a try

@alexdolbun 的头像
@alexdolbun1 天前

Looks interesting

Mathis Dupuy 的头像
Mathis Dupuy1 天前

I love the idea of letting the model building it’s own tools. But what if you need to redo a task ? Should you expect it to find back the same trajectory it did before from ex nihilo ?

Max 🇺🇸 的头像
Max 🇺🇸1 天前

So it's Prime Agent?

Suhaan 的头像
Suhaan1 天前

interesting idea! btw cleanest site i have seen in a while

سالب ألف اورا 的头像
سالب ألف اورا1 天前

I want this for powershell

Dinesh Yadav 的头像
Dinesh Yadav1 天前

always heard that claude models perform better on other harnesses than their own , will check out on this !

相关视频