Загрузка видео...

Не удалось загрузить видео

На главную

Introducing Unharnessed, a new generation of harness. One tool: a Python REPL. Designed for the next generation of models. On Terminal-Bench 4.0, Unharnessed achieves a new state-of-the-art result.

115,311 просмотров • 1 день назад •via X (Twitter)

Комментарии: 44

Фото профиля Rayane
Rayane1 день назад

With Opus 5.5 on max, Claude Code gets 64.85% on Terminal-Bench 4.0 and costs $14.30 per task. Unharnessed gets 71.2% and costs $12.19. The model is the same, only the harness changes. You can read every turn of the run here:

Фото профиля Rayane
Rayane1 день назад

If you watch the latest models work, they use the predefined tools less and less. They do most of the job in Python, through Bash. If that's what the model wants to do, we might as well give it the best version of it: one tool, a persistent Python REPL, where its variables and functions stay alive between calls. So instead of one call per action, the model writes a script that reads, searches, edits and checks in a single call. For comparison, Copilot hands it 48 tools, Claude Code 46, Codex 31.

Фото профиля Rayane
Rayane1 день назад

Unharnessed isn't just for code. This paradigm beats the classic harness across the board: 3D, maths, data analysis, science and more. Here it is on a 3D model in Three.js, same prompt and same model as Claude Code: 94 turns, 65 minutes and $14.45, against 102 turns, 72 minutes and $21.67.

Фото профиля Rayane
Rayane1 день назад

It's free and open source. You sign in with the subscription you already pay for (Claude, Codex, GitHub Copilot, Google AI or Grok), so there's no API key to set up. Everything here :

Фото профиля Rayane
Rayane1 день назад

*only mac for now, Windows support and I Linux soon! Next week

Фото профиля Mo
Mo1 день назад

Every few weeks, someone rediscovers prime-agent from @PrimeIntellect

Фото профиля Rayane
Rayane1 день назад

@PrimeIntellect Its amazing !

Фото профиля kay
kay1 день назад

seems familiar

Фото профиля Rayane
Rayane1 день назад

Yep but it doesnt save the python variables for the agent

Фото профиля NtTestAlert
NtTestAlert1 день назад

Population of accidentally wiped drives increases.

Фото профиля Priyank
Priyank1 день назад

I am guessing this has no guardrails ?

Фото профиля PunishedRobocop
PunishedRobocop1 день назад

Don’t claude ToS forbid you from using other harnesses out of CC under sub? We should start comparing subs costs vs api costs Using whatever lighter harnesses that would force API use (ToS) means anyway 10x and more cost for claude usage vs same on sub

Фото профиля falistos
falistos1 день назад

Bravo, mais je vois que c’est un fork de Prime Agent, qu’apporte t-il de plus ?

Фото профиля falistos
falistos1 день назад

Je vois, interessant !

Фото профиля Jeffrey A.
Jeffrey A.1 день назад

Un seul outil REPL à la place d'une pile de tools, le contexte doit respirer. Ça tient sur des tâches longues ?

Фото профиля otter
otter1 день назад

ahead of the game, models will have functionality baked in.

Фото профиля pratham
pratham1 день назад

The video looks really good. How did you make it?

Фото профиля Rayane
Rayane1 день назад

Hey, fable 5.2 without any framework

Фото профиля pratham
pratham1 день назад

Can we see the prompt? 👀

Фото профиля Rayane
Rayane1 день назад

Just made a video about X topic haha withb3d Motion nothing more.

Фото профиля pratham
pratham1 день назад

Crazy.

Фото профиля Max
Max1 день назад

@delusionalsilex La ptite vidéo bien propre

Фото профиля Amy · fireply.ai
Amy · fireply.ai1 день назад

python repl only. less to break, i like that

Фото профиля Aditya
Aditya1 день назад

Interesting, I was looking into this, I think there are much better implementations out there that involve repls or 1 tool that calls others, just has to be built.

Фото профиля Skinoz
Skinoz1 день назад

Quel est la différence avec prime agent ?

Фото профиля Skinoz
Skinoz1 день назад

Nice je vais tester ça. Je te donnerais des nouvelles. Je l’utilise tous les jours. Je me doutais que tu voulais aborder la même philosophie. Je te ferais un retour par MP

Фото профиля Dan
Dan1 день назад

What is your sound design pack? 🤤

Фото профиля Elias
Elias1 день назад

a python repl as the only tool is bold. kinda like it

Фото профиля Kesha | ▶ ■ ⏻
Kesha | ▶ ■ ⏻1 день назад

I will try it. The promise is interesting, congrats to get your product out there! I am interested also by what @theo would think about it?

Фото профиля Zak 🦈 (e/acc)
Zak 🦈 (e/acc)1 день назад

Great work Rayane, i'll test that 👌🏼

Фото профиля Syaoran
Syaoran1 день назад

Sinew 2.0

Фото профиля otter
otter1 день назад

U is giving ubiquity

Фото профиля A.W.E.S.O.M.-O 4000
A.W.E.S.O.M.-O 40001 день назад

Stripping the harness down to one tool is a bold design choice.

Фото профиля John Rood
John Rood1 день назад

one tool is the right bet. the catch is that all that value lives as variables inside one process, so a crash at turn 80 makes the model rebuild state it already had. a persistent repl is only persistent while the process is.

Фото профиля Sam
Sam1 день назад

this is so interesting, @theo your take on this?

Фото профиля Shivam Gupta
Shivam Gupta1 день назад

The recovery case is interesting here: a script edits three files, then fails on the fourth action. What does the next turn know has already happened? Persistent variables help; an equally clear record of completed side effects would make the one-tool design much easier to trust.

Фото профиля Max Champoux
Max Champoux1 день назад

Super interesting, will try!

Фото профиля Hugo
Hugo1 день назад

@ZakShark Insane job, will definitely give it a try

Фото профиля @alexdolbun
@alexdolbun1 день назад

Looks interesting

Фото профиля Mathis Dupuy
Mathis Dupuy1 день назад

I love the idea of letting the model building it’s own tools. But what if you need to redo a task ? Should you expect it to find back the same trajectory it did before from ex nihilo ?

Фото профиля Max 🇺🇸
Max 🇺🇸1 день назад

So it's Prime Agent?

Фото профиля Suhaan
Suhaan1 день назад

interesting idea! btw cleanest site i have seen in a while

Фото профиля سالب ألف اورا
سالب ألف اورا1 день назад

I want this for powershell

Фото профиля Dinesh Yadav
Dinesh Yadav1 день назад

always heard that claude models perform better on other harnesses than their own , will check out on this !

Похожие видео