Загрузка видео...

Не удалось загрузить видео

На главную

Anthropic engineer: "Harness engineering is a really rare skill right now - and it's hard to know if you're even good at it." how he actually thinks about building the full system: • step 1 → the model. already smarter than we use it. "freeze development - you'd find...

44,590 просмотров • 2 месяцев назад •via X (Twitter)

Комментарии: 23

Фото профиля Gipp 🦅
Gipp 🦅2 месяцев назад

how does deleting steering impact real-world agent reliability?

Фото профиля Codez
Codez2 месяцев назад

Delete steering, and reliability drops fast - you’re not simplifying the agent, you’re removing the thing that keeps autonomy honest.

Фото профиля Granite
Granite2 месяцев назад

still amazed by how smart these engineers sound btw i'm actively studying harness engineering rn

Фото профиля Codez
Codez2 месяцев назад

Also, I’m glad we get to learn directly from the Anthropic team itself. Yeah, harness engineering is where I’m spending most of my time right now.

Фото профиля rewind
rewind2 месяцев назад

model was never the bottleneck

Фото профиля Codez
Codez2 месяцев назад

Maybe in the beginning of AI, but definitely not now.

Фото профиля Yarchi
Yarchi2 месяцев назад

Very clear explanation, thanks for sharing

Фото профиля AdiiX
AdiiX2 месяцев назад

the whole point is step 1 is done, everyone still tuning prompts is fighting last years bottleneck

Фото профиля Codez
Codez2 месяцев назад

yeah, sadly true

Фото профиля 0xRafy
0xRafy2 месяцев назад

Thariq is always shipping alpha, great share bro !

Фото профиля Codez
Codez2 месяцев назад

Yeah, a real legend. I really loved the system he shared on the podcast.

Фото профиля Fabrizio Degeno
Fabrizio Degeno2 месяцев назад

Something new in my feed

Фото профиля Codez
Codez2 месяцев назад

yeah, podcast was posted less then 24-h ago

Фото профиля Muhammad Ali
Muhammad Ali2 месяцев назад

The harness insight is underrated but "delete the steering" only works when your codebase is small enough to fit in context. Past 50K lines the model needs explicit guidance or it drifts into fixing the wrong file. What repo size are you testing this approach on?

Фото профиля Genius💡💹🧲 🤖
Genius💡💹🧲 🤖2 месяцев назад

Learning directly from builders always gives way better insights than random takes

Фото профиля Electrik Dreams
Electrik Dreams2 месяцев назад

RAG as anti-pattern will get pushback, but it's technically sound. At 4k tokens, vector retrieval was necessary infrastructure. At 200k, you're adding latency and fragility for diminishing returns. grep scales.

Фото профиля Adam
Adam2 месяцев назад

The distinction between a stronger model and a better harness is the part most builders miss. Your long-form AI articles deserve one clear home where readers can browse the roadmap, newsletter and best systems—not just a Substack profile. Would a quick homepage concept be useful?

Фото профиля FenixFlow
FenixFlow2 месяцев назад

Deleting steering cuts down on prompt brittleness and over-constraint, letting the model use its native reasoning more freely. In real workflows we've seen it boost reliability on multi-step tasks (fewer hallucinations from forced plans), but it only works well with solid agent harnesses + clean context to catch drift. The engineer basically said they stopped babysitting and started trusting the model more - results improved.

Фото профиля 0xSlyth
0xSlyth2 месяцев назад

skip the hype build the system

Фото профиля Miles S.
Miles S.2 месяцев назад

i’m trying grep before touching another vector database

Фото профиля Neo
Neo2 месяцев назад

The real insight isn't any single step. it's that harness quality is unmeasurable by most teams. You can A/B test a model. Almost nobody has a rigorous way to A/B test a harness, which is exactly why it stays a rare skill.

Фото профиля whydeso
whydeso2 месяцев назад

Optimizing all four steps instead of just the model is key

Фото профиля Shoopy
Shoopy2 месяцев назад

"RAG is an anti-pattern, use grep" is such a spicy line lol. Booking this one

Похожие видео