Loading video...

Video Failed to Load

Go Home

this PDF is a f*cking cheat code for anyone running coding agents Diogo Almeida, founder of Jev and co-author of InstructGPT, published a PDF on building a Jev harness the promise: > up to 200x faster > up to 400x cheaper the speed and the cost both live in...

102,441 views • 2 days ago •via X (Twitter)

13 Comments

小果果炖粥(必回关)'s profile picture
小果果炖粥(必回关)2 days ago

200x faster and 400x cheaper sounds great — but faster and cheaper than what baseline, and on which tasks? If the router sends a hard case to the small model by mistake, the cost of the wrong answer could wipe out the savings. How does Jev handle the mis-routed cases?

Artzy's profile picture
Artzy2 days ago

Worth spinning up just to test the loop separation

TheEasySale(互关,有关必回)'s profile picture
TheEasySale(互关,有关必回)2 days ago

200x/400x 听着吓人,但 harness 的价值不在倍数,在把每次重发明的流程变固定套路:规则、记忆、验证循环写死,agent 不用每轮重新猜。但让它按 PDF 重建 setup,等于把钥匙交出去,权限验证得先锁死,不然省下的时间一次事故就还回去。你实测过 token 对比吗?

exit's profile picture
exit2 days ago

This prompt is worth checking out

Argona's profile picture
Argona2 days ago

jev doing the boring decisions for claude is it open source or api only?

CapitainDave's profile picture
CapitainDave2 days ago

Where is the PDF?

Mohammad Ali's profile picture
Mohammad Ali2 days ago

if p(destructive) is read as a probability, how calibrated is it? same issue as ASR confidence scores. cheap is nice, but the false negative rate on rm -rf type commands is the number that matters

Origin Point's profile picture
Origin Point2 days ago

As agents become more persistent, the value of their work may depend increasingly on how well they preserve context across long-running tasks. Continuity could become as important as raw intelligence.

Jhon Dennis's profile picture
Jhon Dennis2 days ago

把流程搭顺,AI干活能又快又省,真不错。

Shaun's profile picture
Shaun2 days ago

@bot digest

Slonski's profile picture
Slonski2 days ago

a PDF from an InstructGPT co-author isn't just a guide - it's a proven methodology

feifie's profile picture
feifie2 days ago

Interesting direction. For those speed and cost comparisons, what quality threshold and task mix were used? The routing trade-off is most useful when we can see failure rates alongside the savings.

George Kotzamanis's profile picture
George Kotzamanis2 days ago

The interesting question is where the savings come from: fewer frontier calls, less context, or fewer retries? That breakdown would show which parts of the harness generalize across coding tasks.

Related Videos

This is f*cking insane. Boris Cherny, the man who built Claude Code, was asked if people should still learn to code. His answer: "In a year or two, it's not going to matter" In 73 seconds, he explains what to do instead: play with the AI tools, learn them, don't be scared of them, stay on the frontier On his team, everyone codes now. The PM, the designer, even the finance guy He hasn't edited a single line of code by hand since last November. He ships 10 to 30 pull requests a day Writing Code → Prompting → Agents → Harness → Loops → Everyone on the Team Ships Claude Code is a harness: the tools, memory, rules and loops around the model. His team changes it with every new model and cut 80% of its system prompt Save this before it disappears from your feed Every doc, guide and repo below is free: Claude Code best practices Effective harnesses for long-running agents Building effective agents Claude Code docs Memory: how Claude remembers your project Custom subagents Hooks: rules the agent can't skip Skills Run Claude Code on a schedule Free course: Claude Code in Action Claude Code on GitHub Claude Code inside your PRs and issues Build your own agent on the same harness The best Claude Code resources in one list Plugins, agents and skills for Claude Code He compares it to the printing press. Writing went from a few scribes to everyone. Building software is next 95% will keep asking whether to learn to code, the 5% who build a harness will ship 30 pull requests a day Bookmark it and read the first link tonight Then use the guide below to build your harness before everyone else does ↓

Sanabi

207,475 views • 2 days ago

Harness Engineering 2.0 is here! We benchmark models all the time but the harness running the model can dramatically improve the result, cost, and execution time too. And finally, devs just open-sourced Harness Arena, where you can test the same task across multiple harness and model combinations side by side. You provide one task and then run it across several model x harness configs that you want to test. Every config receives the same prompt, files, tools, skills, and evaluation checks. Harness Arena then returns: - total cost - execution time - whether the task passed - files and artifacts produced If you want to try it yourself, it is implemented within the open-source HarnessRouter project. Here's the repo: (don't forget to star it ⭐ ) HarnessRouter is a plug-and-play infrastructure layer that lets you run any harness under a single interface, like: - Codex - Hermes - Claude code - DeepSeek Harness - System One, powered by Jev - And 25 more agent harnesses In Harness Arena, the cheapest run does not automatically win. A config must complete the task correctly first. Cost and execution time are compared only among the configurations that pass. Here's the result from one Harness Arena test: - Hermes + GPT-5.2: 5/5 successful runs using 0.47 credits - Claude Code + Opus 4.8: 3/5 successful runs using 223 credits That is around 474x difference in credits, while the more expensive configuration also failed two runs. You can keep the model fixed to measure how much the harness changes the result. Or vary both to find the best harness and model pairing for that task. This helps answer practical questions such as: - Should this task run on Codex or Claude? - Can a cheaper config still pass every check? - Which setup is best to handle this workload? Once you find the best config, you can run future tasks through it using the same Unified Harness Protocol (UHP) interface for sessions, streaming, files, artifacts, cancellation, and failures. So you are no longer choosing an agent stack based only on a model leaderboard. Instead, you can benchmark the complete runtime on the task your product actually needs to solve. To dive deeper, my co-founder wrote an article explaining why model routing is different from harness routing, how UHP works, and what supporting multiple agent runtimes involves. It also covers the local setup, a working request, and how sessions and files move through the system. Read it below.

Avi Chawla

31,532 views • 7 days ago

This is f*cking wild. Someone asked Anthropic CEO Dario Amodei what a kid finishing high school should do right now. He didn't sugarcoat it: "AI can do entry-level law work. It can do entry-level finance. It can do entry-level consulting. AI will also eliminate jobs, and probably a large number of them" In 42 seconds, he lists the first careers in the line of fire: junior law, junior finance, junior consulting He's already put a number on it: half of entry-level white-collar jobs disrupted within 1 to 5 years Every shift before this one, from farms to factories to the internet, gave people time to catch up. This one, he says, cuts deeper and moves faster Chatting → Prompting → Agents → Harness → Loops → You Run the AI His advice is simple: learn to use AI. But using it is now the bare minimum. What sets you apart is a harness that runs it for you Bookmark this before your feed buries it Every repo below costs nothing: Ready-made Claude plugins for legal, finance, sales, HR and data Analyst-grade agents: models, memos, research notes Skills for Excel, Word, PowerPoint and PDF An agent that does financial research on its own An agent that researches any topic in depth Ask your spreadsheets and databases questions in plain English Agents that work as a team, each with its own role A harness with everything built in Anthropic's SDK for building your own agents A memory layer so your agents remember context A loop that keeps the agent going until the job is done An agent that clicks through websites and fills forms for you Automate busywork with drag-and-drop workflows 18 free lessons on building agents Total cost: $0 It won't be AI that takes your seat. It'll be someone who built a harness 95% will keep sending résumés for work AI already does, the 5% with a harness will be the ones managing it Save it and forward it to anyone starting their first job Then follow the guide below and build your harness while everyone else is still waiting ↓

Sanabi

4,461,107 views • 3 days ago