Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Introducing Unharnessed, a new generation of harness. One tool: a Python REPL. Designed for the next generation of models. On Terminal-Bench 4.0, Unharnessed achieves a new state-of-the-art result.

115,311 görüntüleme • 1 gün önce •via X (Twitter)

44 Yorum

Rayane profil fotoğrafı
Rayane1 gün önce

With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19. The model is the same, only the harness changes. You can read every turn of the run here:

Rayane profil fotoğrafı
Rayane1 gün önce

If you watch the latest models work, they use the predefined tools less and less. They do most of the job in Python, through Bash. If that's what the model wants to do, we might as well give it the best version of it: one tool, a persistent Python REPL, where its variables and functions stay alive between calls. So instead of one call per action, the model writes a script that reads, searches, edits and checks in a single call. For comparison, Copilot hands it 48 tools, Claude Code 46, Codex 31.

Rayane profil fotoğrafı
Rayane1 gün önce

Unharnessed isn't just for code. This paradigm beats the classic harness across the board: 3D, maths, data analysis, science and more. Here it is on a 3D model in Three.js, same prompt and same model as Claude Code: 94 turns, 65 minutes and $14.45, against 102 turns, 72 minutes and $21.67.

Rayane profil fotoğrafı
Rayane1 gün önce

It's free and open source. You sign in with the subscription you already pay for (Claude, Codex, GitHub Copilot, Google AI or Grok), so there's no API key to set up. Everything here :

Rayane profil fotoğrafı
Rayane1 gün önce

*only mac for now, Windows support and I Linux soon! Next week

Mo profil fotoğrafı
Mo1 gün önce

Every few weeks, someone rediscovers prime-agent from @PrimeIntellect

Rayane profil fotoğrafı
Rayane1 gün önce

@PrimeIntellect Its amazing !

kay profil fotoğrafı
kay1 gün önce

seems familiar

Rayane profil fotoğrafı
Rayane1 gün önce

Yep but it doesnt save the python variables for the agent

NtTestAlert profil fotoğrafı
NtTestAlert1 gün önce

Population of accidentally wiped drives increases.

Priyank profil fotoğrafı
Priyank1 gün önce

I am guessing this has no guardrails ?

PunishedRobocop profil fotoğrafı
PunishedRobocop1 gün önce

Don’t claude ToS forbid you from using other harnesses out of CC under sub? We should start comparing subs costs vs api costs Using whatever lighter harnesses that would force API use (ToS) means anyway 10x and more cost for claude usage vs same on sub

falistos profil fotoğrafı
falistos1 gün önce

Bravo, mais je vois que c’est un fork de Prime Agent, qu’apporte t-il de plus ?

falistos profil fotoğrafı
falistos1 gün önce

Je vois, interessant !

Jeffrey A. profil fotoğrafı
Jeffrey A.1 gün önce

Un seul outil REPL à la place d'une pile de tools, le contexte doit respirer. Ça tient sur des tâches longues ?

otter profil fotoğrafı
otter1 gün önce

ahead of the game, models will have functionality baked in.

pratham profil fotoğrafı
pratham1 gün önce

The video looks really good. How did you make it?

Rayane profil fotoğrafı
Rayane1 gün önce

Hey, fable 5.2 without any framework

pratham profil fotoğrafı
pratham1 gün önce

Can we see the prompt? 👀

Rayane profil fotoğrafı
Rayane1 gün önce

Just made a video about X topic haha withb3d Motion nothing more.

pratham profil fotoğrafı
pratham1 gün önce

Crazy.

Max profil fotoğrafı
Max1 gün önce

@delusionalsilex La ptite vidéo bien propre

Amy · fireply.ai profil fotoğrafı
Amy · fireply.ai1 gün önce

python repl only. less to break, i like that

Aditya profil fotoğrafı
Aditya1 gün önce

Interesting, I was looking into this, I think there are much better implementations out there that involve repls or 1 tool that calls others, just has to be built.

Skinoz profil fotoğrafı
Skinoz1 gün önce

Quel est la différence avec prime agent ?

Skinoz profil fotoğrafı
Skinoz1 gün önce

Nice je vais tester ça. Je te donnerais des nouvelles. Je l’utilise tous les jours. Je me doutais que tu voulais aborder la même philosophie. Je te ferais un retour par MP

Dan profil fotoğrafı
Dan1 gün önce

What is your sound design pack? 🤤

Elias profil fotoğrafı
Elias1 gün önce

a python repl as the only tool is bold. kinda like it

Kesha | ▶ ■ ⏻ profil fotoğrafı
Kesha | ▶ ■ ⏻1 gün önce

I will try it. The promise is interesting, congrats to get your product out there! I am interested also by what @theo would think about it?

Zak 🦈 (e/acc) profil fotoğrafı
Zak 🦈 (e/acc)1 gün önce

Great work Rayane, i'll test that 👌🏼

Syaoran profil fotoğrafı
Syaoran1 gün önce

Sinew 2.0

otter profil fotoğrafı
otter1 gün önce

U is giving ubiquity

A.W.E.S.O.M.-O 4000 profil fotoğrafı
A.W.E.S.O.M.-O 40001 gün önce

Stripping the harness down to one tool is a bold design choice.

John Rood profil fotoğrafı
John Rood1 gün önce

one tool is the right bet. the catch is that all that value lives as variables inside one process, so a crash at turn 80 makes the model rebuild state it already had. a persistent repl is only persistent while the process is.

Sam profil fotoğrafı
Sam1 gün önce

this is so interesting, @theo your take on this?

Shivam Gupta profil fotoğrafı
Shivam Gupta1 gün önce

The recovery case is interesting here: a script edits three files, then fails on the fourth action. What does the next turn know has already happened? Persistent variables help; an equally clear record of completed side effects would make the one-tool design much easier to trust.

Max Champoux profil fotoğrafı
Max Champoux1 gün önce

Super interesting, will try!

Hugo profil fotoğrafı
Hugo1 gün önce

@ZakShark Insane job, will definitely give it a try

@alexdolbun profil fotoğrafı
@alexdolbun1 gün önce

Looks interesting

Mathis Dupuy profil fotoğrafı
Mathis Dupuy1 gün önce

I love the idea of letting the model building it’s own tools. But what if you need to redo a task ? Should you expect it to find back the same trajectory it did before from ex nihilo ?

Max 🇺🇸 profil fotoğrafı
Max 🇺🇸1 gün önce

So it's Prime Agent?

Suhaan profil fotoğrafı
Suhaan1 gün önce

interesting idea! btw cleanest site i have seen in a while

سالب ألف اورا profil fotoğrafı
سالب ألف اورا1 gün önce

I want this for powershell

Dinesh Yadav profil fotoğrafı
Dinesh Yadav1 gün önce

always heard that claude models perform better on other harnesses than their own , will check out on this !

Benzer Videolar