Loading video...

Video Failed to Load

Go Home

Anthropic engineer: "Harness engineering is a really rare skill right now - and it's hard to know if you're even good at it." how he actually thinks about building the full system: • step 1 → the model. already smarter than we use it. "freeze development - you'd find...

44,590 views • 2 months ago •via X (Twitter)

23 Comments

Gipp 🦅's profile picture
Gipp 🦅2 months ago

how does deleting steering impact real-world agent reliability?

Codez's profile picture
Codez2 months ago

Delete steering, and reliability drops fast - you’re not simplifying the agent, you’re removing the thing that keeps autonomy honest.

Granite's profile picture
Granite2 months ago

still amazed by how smart these engineers sound btw i'm actively studying harness engineering rn

Codez's profile picture
Codez2 months ago

Also, I’m glad we get to learn directly from the Anthropic team itself. Yeah, harness engineering is where I’m spending most of my time right now.

rewind's profile picture
rewind2 months ago

model was never the bottleneck

Codez's profile picture
Codez2 months ago

Maybe in the beginning of AI, but definitely not now.

Yarchi's profile picture
Yarchi2 months ago

Very clear explanation, thanks for sharing

AdiiX's profile picture
AdiiX2 months ago

the whole point is step 1 is done, everyone still tuning prompts is fighting last years bottleneck

Codez's profile picture
Codez2 months ago

yeah, sadly true

0xRafy's profile picture
0xRafy2 months ago

Thariq is always shipping alpha, great share bro !

Codez's profile picture
Codez2 months ago

Yeah, a real legend. I really loved the system he shared on the podcast.

Fabrizio Degeno's profile picture
Fabrizio Degeno2 months ago

Something new in my feed

Codez's profile picture
Codez2 months ago

yeah, podcast was posted less then 24-h ago

Muhammad Ali's profile picture
Muhammad Ali2 months ago

The harness insight is underrated but "delete the steering" only works when your codebase is small enough to fit in context. Past 50K lines the model needs explicit guidance or it drifts into fixing the wrong file. What repo size are you testing this approach on?

Genius💡💹🧲 🤖's profile picture
Genius💡💹🧲 🤖2 months ago

Learning directly from builders always gives way better insights than random takes

Electrik Dreams's profile picture
Electrik Dreams2 months ago

RAG as anti-pattern will get pushback, but it's technically sound. At 4k tokens, vector retrieval was necessary infrastructure. At 200k, you're adding latency and fragility for diminishing returns. grep scales.

Adam's profile picture
Adam2 months ago

The distinction between a stronger model and a better harness is the part most builders miss. Your long-form AI articles deserve one clear home where readers can browse the roadmap, newsletter and best systems—not just a Substack profile. Would a quick homepage concept be useful?

FenixFlow's profile picture
FenixFlow2 months ago

Deleting steering cuts down on prompt brittleness and over-constraint, letting the model use its native reasoning more freely. In real workflows we've seen it boost reliability on multi-step tasks (fewer hallucinations from forced plans), but it only works well with solid agent harnesses + clean context to catch drift. The engineer basically said they stopped babysitting and started trusting the model more - results improved.

0xSlyth's profile picture
0xSlyth2 months ago

skip the hype build the system

Miles S.'s profile picture
Miles S.2 months ago

i’m trying grep before touching another vector database

Neo's profile picture
Neo2 months ago

The real insight isn't any single step. it's that harness quality is unmeasurable by most teams. You can A/B test a model. Almost nobody has a rigorous way to A/B test a harness, which is exactly why it stays a rare skill.

whydeso's profile picture
whydeso2 months ago

Optimizing all four steps instead of just the model is key

Shoopy's profile picture
Shoopy2 months ago

"RAG is an anti-pattern, use grep" is such a spicy line lol. Booking this one

Related Videos