Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

this PDF is a f*cking cheat code for anyone running coding agents Diogo Almeida, founder of Jev and co-author of InstructGPT, published a PDF on building a Jev harness the promise: > up to 200x faster > up to 400x cheaper the speed and the cost both live in...

102,441 Aufrufe • vor 3 Tagen •via X (Twitter)

13 Kommentare

Profilbild von 小果果炖粥(必回关)
小果果炖粥(必回关)vor 2 Tagen

200x faster and 400x cheaper sounds great — but faster and cheaper than what baseline, and on which tasks? If the router sends a hard case to the small model by mistake, the cost of the wrong answer could wipe out the savings. How does Jev handle the mis-routed cases?

Profilbild von Artzy
Artzyvor 2 Tagen

Worth spinning up just to test the loop separation

Profilbild von TheEasySale(互关,有关必回)
TheEasySale(互关,有关必回)vor 2 Tagen

200x/400x 听着吓人,但 harness 的价值不在倍数,在把每次重发明的流程变固定套路:规则、记忆、验证循环写死,agent 不用每轮重新猜。但让它按 PDF 重建 setup,等于把钥匙交出去,权限验证得先锁死,不然省下的时间一次事故就还回去。你实测过 token 对比吗?

Profilbild von exit
exitvor 3 Tagen

This prompt is worth checking out

Profilbild von Argona
Argonavor 3 Tagen

jev doing the boring decisions for claude is it open source or api only?

Profilbild von CapitainDave
CapitainDavevor 2 Tagen

Where is the PDF?

Profilbild von Mohammad Ali
Mohammad Alivor 2 Tagen

if p(destructive) is read as a probability, how calibrated is it? same issue as ASR confidence scores. cheap is nice, but the false negative rate on rm -rf type commands is the number that matters

Profilbild von Origin Point
Origin Pointvor 2 Tagen

As agents become more persistent, the value of their work may depend increasingly on how well they preserve context across long-running tasks. Continuity could become as important as raw intelligence.

Profilbild von Jhon Dennis
Jhon Dennisvor 2 Tagen

把流程搭顺,AI干活能又快又省,真不错。

Profilbild von Shaun
Shaunvor 2 Tagen

@bot digest

Profilbild von Slonski
Slonskivor 2 Tagen

a PDF from an InstructGPT co-author isn't just a guide - it's a proven methodology

Profilbild von feifie
feifievor 2 Tagen

Interesting direction. For those speed and cost comparisons, what quality threshold and task mix were used? The routing trade-off is most useful when we can see failure rates alongside the savings.

Profilbild von George Kotzamanis
George Kotzamanisvor 2 Tagen

The interesting question is where the savings come from: fewer frontier calls, less context, or fewer retries? That breakdown would show which parts of the harness generalize across coding tasks.

Ähnliche Videos

This is f*cking insane. Boris Cherny, the man who built Claude Code, was asked if people should still learn to code. His answer: "In a year or two, it's not going to matter" In 73 seconds, he explains what to do instead: play with the AI tools, learn them, don't be scared of them, stay on the frontier On his team, everyone codes now. The PM, the designer, even the finance guy He hasn't edited a single line of code by hand since last November. He ships 10 to 30 pull requests a day Writing Code → Prompting → Agents → Harness → Loops → Everyone on the Team Ships Claude Code is a harness: the tools, memory, rules and loops around the model. His team changes it with every new model and cut 80% of its system prompt Save this before it disappears from your feed Every doc, guide and repo below is free: Claude Code best practices Effective harnesses for long-running agents Building effective agents Claude Code docs Memory: how Claude remembers your project Custom subagents Hooks: rules the agent can't skip Skills Run Claude Code on a schedule Free course: Claude Code in Action Claude Code on GitHub Claude Code inside your PRs and issues Build your own agent on the same harness The best Claude Code resources in one list Plugins, agents and skills for Claude Code He compares it to the printing press. Writing went from a few scribes to everyone. Building software is next 95% will keep asking whether to learn to code, the 5% who build a harness will ship 30 pull requests a day Bookmark it and read the first link tonight Then use the guide below to build your harness before everyone else does ↓

Sanabi

207,475 Aufrufe • vor 2 Tagen

Harness Engineering 2.0 is here! We benchmark models all the time but the harness running the model can dramatically improve the result, cost, and execution time too. And finally, devs just open-sourced Harness Arena, where you can test the same task across multiple harness and model combinations side by side. You provide one task and then run it across several model x harness configs that you want to test. Every config receives the same prompt, files, tools, skills, and evaluation checks. Harness Arena then returns: - total cost - execution time - whether the task passed - files and artifacts produced If you want to try it yourself, it is implemented within the open-source HarnessRouter project. Here's the repo: (don't forget to star it ⭐ ) HarnessRouter is a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 25 more agent harnesses In Harness Arena, the cheapest run does not automatically win. A config must complete the task correctly first. Cost and execution time are compared only among the configurations that pass. Here's the result from one Harness Arena test: - Hermes + GPT-5.2: 5/5 successful runs using 0.47 credits - Claude Code + Opus 4.8: 3/5 successful runs using 223 credits That is around 474x difference in credits, while the more expensive configuration also failed two runs. You can keep the model fixed to measure how much the harness changes the result. Or vary both to find the best harness and model pairing for that task. This helps answer practical questions such as: - Should this task run on Codex or Claude? - Can a cheaper config still pass every check? - Which setup is best to handle this workload? Once you find the best config, you can run future tasks through it using the same Unified Harness Protocol (UHP) interface for sessions, streaming, files, artifacts, cancellation, and failures. So you are no longer choosing an agent stack based only on a model leaderboard. Instead, you can benchmark the complete runtime on the task your product actually needs to solve. To dive deeper, my co-founder wrote an article explaining why model routing is different from harness routing, how UHP works, and what supporting multiple agent runtimes involves. It also covers the local setup, a working request, and how sessions and files move through the system. Read it below.

Avi Chawla

31,532 Aufrufe • vor 7 Tagen

This is f*cking wild. Someone asked Anthropic CEO Dario Amodei what a kid finishing high school should do right now. He didn't sugarcoat it: "AI can do entry-level law work. It can do entry-level finance. It can do entry-level consulting. AI will also eliminate jobs, and probably a large number of them" In 42 seconds, he lists the first careers in the line of fire: junior law, junior finance, junior consulting He's already put a number on it: half of entry-level white-collar jobs disrupted within 1 to 5 years Every shift before this one, from farms to factories to the internet, gave people time to catch up. This one, he says, cuts deeper and moves faster Chatting → Prompting → Agents → Harness → Loops → You Run the AI His advice is simple: learn to use AI. But using it is now the bare minimum. What sets you apart is a harness that runs it for you Bookmark this before your feed buries it Every repo below costs nothing: Ready-made Claude plugins for legal, finance, sales, HR and data Analyst-grade agents: models, memos, research notes Skills for Excel, Word, PowerPoint and PDF An agent that does financial research on its own An agent that researches any topic in depth Ask your spreadsheets and databases questions in plain English Agents that work as a team, each with its own role A harness with everything built in Anthropic's SDK for building your own agents A memory layer so your agents remember context A loop that keeps the agent going until the job is done An agent that clicks through websites and fills forms for you Automate busywork with drag-and-drop workflows 18 free lessons on building agents Total cost: $0 It won't be AI that takes your seat. It'll be someone who built a harness 95% will keep sending résumés for work AI already does, the 5% with a harness will be the ones managing it Save it and forward it to anyone starting their first job Then follow the guide below and build your harness while everyone else is still waiting ↓

Sanabi

4,463,127 Aufrufe • vor 3 Tagen