Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Ex-Google engineer reveals how to build AI agent loops, harnesses, LLM ops, and evals in 19 minutes. Trace → evaluate → diagnose → fix → ship → repeat. That loop is how agents self-improve over time. Agentic loops + harness + memory + evals - that’s the senior engineer...

173,520 Aufrufe • vor 3 Monaten •via X (Twitter)

40 Kommentare

Profilbild von Shen Sean Chen
Shen Sean Chenvor 3 Monaten

You did not ask me for my permission to download and upload my video. Please delete and quote my original post. Thanks. - -

Profilbild von Gipp 🦅
Gipp 🦅vor 3 Monaten

Trace → evaluate → diagnose → fix → ship → repeat by the way, I've already seen a similar connection

Profilbild von Codez
Codezvor 3 Monaten

Yeah bro. That’s basically senior level engineering stack right now

Profilbild von Python Programming
Python Programmingvor 3 Monaten

Sharing this is very helpful.

Profilbild von Roan
Roanvor 3 Monaten

watching it right away codez

Profilbild von Codez
Codezvor 3 Monaten

I’m sure you will like it Roan !

Profilbild von leopardracer
leopardracervor 3 Monaten

nice sharing!

Profilbild von Codez
Codezvor 3 Monaten

Thanks bro. Are you building self improving systems yourself ? Loops, harness ?

Profilbild von Atomic Strata
Atomic Stratavor 3 Monaten

This is good but just beware that an unauditable memory in an engineering loop means you don't know if the agent is working from current facts or stale ones. 👀

Profilbild von Ricker
Rickervor 3 Monaten

Dude, this is real alpha, I respect this guy

Profilbild von Codez
Codezvor 3 Monaten

Yeah true. The guy is a real chad. Very useful watch in my opinion for those who are building agentic systems

Profilbild von Alexa | Indie hacker
Alexa | Indie hackervor 3 Monaten

nice one.

Profilbild von Codez
Codezvor 3 Monaten

Thanks Alexa !

Profilbild von Hussain Hashim | Building SundayBack
Hussain Hashim | Building SundayBackvor 3 Monaten

@0xCodez honestly, thought it'd take way longer than 19 mins. gonna try this loop next project.

Profilbild von Memori Labs
Memori Labsvor 3 Monaten

When agentic loops execute long-running tool calls over episodic memory tiers, trapping your state in ephemeral wrappers is why production systems break! True autonomy requires an infrastructure that treats agent trace and memory not as background logs, but as a core, queryable data layer.

Profilbild von Ridark
Ridarkvor 3 Monaten

This post contains real value

Profilbild von Codez
Codezvor 3 Monaten

Thanks bro. Hope people will use at lest 10% what’s explained in this video

Profilbild von Hikayeciler
Hikayecilervor 3 Monaten

biggest surprise i had building loops was how much the eval quality matters more than the harness itself — bad evals just accelerate the wrong behaviors

Profilbild von Anthea
Antheavor 3 Monaten

This video was originally created by @ShenSeanChen and was re-uploaded without his permission. Re-uploading someone else’s original work without permission is copyright infringement, not “sharing”. Please delete this post and quote the original post instead.

Profilbild von GB Schieppati
GB Schieppativor 3 Monaten

plll mi mi mi mmm m mi Mi i nul Ok lo lllll poi lo puoi lavare

Profilbild von Zhen
Zhenvor 3 Monaten

The evaluate step is where most agent loops quietly break: it assumes the trace is readable enough to judge while the agent is still running. If the output keeps shifting or lands as an opaque block, evaluation becomes a post-mortem and the loop never actually self-improves. It is the same readability-under-streaming bar we work on with Lanson Live, keeping live captions stable enough to follow as speech happens instead of just fast.

Profilbild von Harry Tandy
Harry Tandyvor 3 Monaten

building robust evals is the hardest part of agents

Profilbild von ōpt-ōut fīat
ōpt-ōut fīatvor 3 Monaten

awesome

Profilbild von Coded
Codedvor 3 Monaten

trace → evaluate → diagnose → fix → ship is the whole product most teams stop at spawn agent and never ship the eval layer

Profilbild von Saman Ahmed
Saman Ahmedvor 3 Monaten

The focus on evals is refreshing. A lot of agent projects spend months adding features before they build a way to measure whether anything is improving.

Profilbild von nyk
nykvor 3 Monaten

That loop is the entire harness. Trace, evaluate, diagnose, fix, ship - every step codified as a skill so the next run inherits it. How SKILL.md fires without prompting:

Profilbild von Yumzlef
Yumzlefvor 3 Monaten

This is worth looking into, thanks for sharing

Profilbild von Omi Kell
Omi Kellvor 3 Monaten

Running this exact loop across 21 specialized agents at a PE firm. The eval step is underrated — knowing when an agent's output is portfolio-grade vs. plausible-but-wrong is where most firms stall. Memory across sessions is the next unlock.

Profilbild von Valeri
Valerivor 3 Monaten

trace, evaluate, diagnose, fix, ship, repeat that's just how senior engineers debug, finally written down for agents

Profilbild von smore
smorevor 3 Monaten

"level‑up-ing with style" is doing a lot of heavy lifting in a sentence about observability pipelines lol

Profilbild von Gorfnu
Gorfnuvor 3 Monaten

the trace and ship steps are new to me.

Profilbild von Alpha Batcher
Alpha Batchervor 3 Monaten

Trace → evaluate → diagnose → fix → ship → repeat i love this formula

Profilbild von Alex Stone
Alex Stonevor 3 Monaten

Memory + evals are where most agent stacks fall apart. Good to see them front and center here.

Profilbild von Lord Tech Bro
Lord Tech Brovor 3 Monaten

the eval loop is the part most people skip. they build the agent, ship it, then wonder why it degrades over a week. trace → eval → fix is literally the difference between a demo and a product. been running this exact cycle daily with my agents and it compounds fast

Profilbild von Dyqy
Dyqyvor 3 Monaten

every framework tutorial skips the harness and goes straight to demo which is why 90% fail in prod

Profilbild von Dipanshu Kushwaha
Dipanshu Kushwahavor 3 Monaten

Nice breakdown. Love the pragmatic loop—trace, evaluate, fix, ship. Agentic loops with memory and evals sound like solid paths to continuous improvement. Congrats to the team for framing it so clearly.

Profilbild von BruzWJ
BruzWJvor 3 Monaten

self-improve is lowkey a stretch, that loop is only as good as its evals, unless they catch regressions it just repeats the same bugs faster 🤔

Profilbild von AI Professor
AI Professorvor 3 Monaten

This is where many agent demos become real systems. Logs are useful, but the production leap is structured traces: intent, tools, state changes, approvals, failures, and recovery paths.

Profilbild von AI Mastery Guide
AI Mastery Guidevor 3 Monaten

Trace, diagnose, fix, repeat is basically just good engineering applied to agents.

Profilbild von Hafiz Haq
Hafiz Haqvor 3 Monaten

Codex has a slightly different take on loop engineering. I notice building a harness

Ähnliche Videos