Loading video...

Video Failed to Load

Go Home

IBM engineers just released a 40-minute deep dive into “Agent Engineering” for building production-ready AI agents “80% of building an AI agent has nothing to do with the model. It is frameworks, tools, skills and risk controls.” 00:00 - the 5 core concepts behind every AI agent 11:07 -...

14,597 views • 2 months ago •via X (Twitter)

35 Comments

Alex's profile picture
Alex2 months ago

that's what i find, thanks

Morlex's profile picture
Morlex2 months ago

enjoyed

Hussain Hashim | Building SundayBack's profile picture
Hussain Hashim | Building SundayBack2 months ago

@0xMorlex honestly didn't realize how much goes into the non-model stuff. makes you appreciate the work behind "just throw GPT at it" solutions lol

Precipitate Protocol's profile picture
Precipitate Protocol2 months ago

That 80% number tracks. Of our ~110 scheduled jobs, maybe 15% is prompts/model — the rest is retries, idempotency, and knowing when to page a human instead of quietly failing.

dunik's profile picture
dunik2 months ago

Morlex, new alpha every day. how you find this info?

Morlex's profile picture
Morlex2 months ago

a lot of in gpt mate

安叫兽|Bird🕊️ 🔶 BNB's profile picture
安叫兽|Bird🕊️ 🔶 BNB2 months ago

40 分钟有点长,但这几个点还挺适合跳着看

Ashutosh Tiwari's profile picture
Ashutosh Tiwari2 months ago

This tracks hard. Most people still treat agents like “better prompts + tools”. In production the real work is: • retry & idempotency logic • clear failure modes • knowing when to escalate to a human • cost + latency observability The model is maybe 15-20%. Everything else is systems engineering.

The AI Breakroom's profile picture
The AI Breakroom2 months ago

That 80% line is the part people underestimate. Models matter, but the behavior layer around tools, memory, guardrails, incentives, and recovery is what decides whether an agent survives real use.

nyk's profile picture
nyk2 months ago

The 80/20 split tracks with what actually breaks: rarely the model, usually the retry loop around a flaky tool call. How to Actually Debug Agent Failures: 5 Harness Checks a Bigger Model Cannot Fix

Harley Lewis Foote's profile picture
Harley Lewis Foote2 months ago

80% frameworks, 20% model — and 100% of that framework is 'what did you actually want'

코지베어 🐻 CozyBear's profile picture
코지베어 🐻 CozyBear2 months ago

The "building an agent is mostly not the model" framing is exactly right, yet everyone who starts one learns it late. For us the recurring killer is state and permission edges, not prompts. Curious - in that deep dive, do they weight the control loop and observability above memory design?

creeeeng's profile picture
creeeeng2 months ago

if it doesn't save time in a week I cut it

Shubh Thorat's profile picture
Shubh Thorat2 months ago

this matches what i see building plugins on the side. the model call is like 10% of the actual work, rest is glue code and edge cases

hailports's profile picture
hailports2 months ago

that's a tough pill to swallow. i bet most devs would swap 20% of their model expertise for 10x better risk management skills

Rafie Faruq's profile picture
Rafie Faruq2 months ago

The 80% figure is right, and in legal it's closer to 95%. Nobody cares that a model can draft a clause, they care whether it followed your playbook and caught the term that kills the deal. Risk controls aren't a wrapper round the product at @GenieAI, they are the product.

Leo Amos's profile picture
Leo Amos2 months ago

The 80% is tools, frameworks and skills, exactly. That is the whole reason Even exists, the model is the commodity, the environment around it is the moat.

@sh0wgg's profile picture
@sh0wgg2 months ago

This is what I did to manage agentic AI with graph

thatdatagirl's profile picture
thatdatagirl2 months ago

80 percent not being the model is a pretty important reality check lol. tools skills and risk controls are where the benchmark gets interesting 🤖

Miles S.'s profile picture
Miles S.2 months ago

risk controls are where most agent demos fall apart

Jurly's profile picture
Jurly2 months ago

the "80% is not the model" line is the part most teams learn the hard way. tooling and guardrails are where production agents actually live.

Empyre's profile picture
Empyre1 month ago

80% of agent engineering really is risk controls and harnesses. if your agents can grep master env files, prompt guardrails are completely useless.

Rouzbeh's profile picture
Rouzbeh2 months ago

This matches what I’m seeing in practice. Once the model is good enough, the real work shifts to tooling, memory, and risk controls.

0xJust1n.eth's profile picture
0xJust1n.eth2 months ago

The 80% outside the model is where agents usually die: permissions, tool failures, evals, and rollback. A clean framework diagram is easy; proving the system fails safely is the real production work.

Tony Tong | Founder | Ancient Systems x AI's profile picture
Tony Tong | Founder | Ancient Systems x AI2 months ago

80% of building an agent has nothing to do with the model. Same goes for life's biggest decisions. They're rarely clear-cut. Most are 51/49 calls where frameworks narrow the field but you still have to leap.

Kuncoro's profile picture
Kuncoro2 months ago

The security case lives in that 80% too. An agent's blast radius is the union of the permissions its tools carry, which is decided in the plumbing rather than in the model. Blockaid's H1 report already logs a prompt injection that reached a crypto agent's payment authority.

Irfan's profile picture
Irfan2 months ago

I spent about a day picking the model for my agent setup and weeks getting the scheduler, retry logic, and context passing to actually work reliably.

Andrew I. Christianson's profile picture
Andrew I. Christianson2 months ago

the model still matters at the failure edges, but most production pain really is outside it. the expensive bugs are usually state, recovery, tool permissions, and evidence: what woke the agent up, what changed, what it tried, and whether someone can safely resume the work.

Sam's profile picture
Sam2 months ago

Nothing to do with the model" is a useful correction but it overcorrects. The 20% matters a lot when your use case is domain-specific. I spent weeks tuning Grok with x_search for pharma/regulatory signal detection. The tooling was trivial compared to figuring out which model actually understood SFDA terminology without hallucinating.

Marco Iannello's profile picture
Marco Iannello2 months ago

Putting risk before production made me grin 🙂 It’s a small ordering choice, but an honest one for anyone trying to ship agents.

Mike|AI SOP Lab's profile picture
Mike|AI SOP Lab2 months ago

The 80% point resonates: production reliability usually lives in tool contracts, permissions, observability, and recovery paths. A capable model can still fail if the surrounding system cannot explain or contain its actions.

sindikitil's profile picture
sindikitil2 months ago

That 80% stat hits. Everyone fixates on models but the plumbing matters more once you actually ship something.

Tony Tong | Founder | Ancient Systems x AI's profile picture
Tony Tong | Founder | Ancient Systems x AI2 months ago

IBM says 80% of agent engineering isn't the model. What they don't say: the other 20% fails when you only speak one language. Rigid logic breaks. Ungrounded intuition drifts. The bridge is where production systems actually work.

wearzdk's profile picture
wearzdk2 months ago

Tool access is half the job. Publish from the user's own logged-in machine. PublishPort:

Wei佳's profile picture
Wei佳2 months ago

That 80% estimate matches what breaks first in production: tool contracts, retries, permissions, observability, and cost controls. Model choice is one layer.

Related Videos

Anthropic's Claude Ai Agents Team just Educated how to build production AI agents in under 30 mins. For Free. From the engineers who built the stack. CANCEL Your Weekend Plans, and Learn to Build AI Agents Today. Bookmark it. Watch it. Build your first production agent this weekend. $5,000/month. $7,000/month. $12,000/month. People are building agents for clients and charging $$$ as Beginners. You're still stuck in the thinking about AI phase. This video fixes that tonight. Follow Himanshu Kumar for more high-signal content that actually moves your AI engineering career forward. ↓ Ivan Nardini runs Developer Relations for AI at Google Cloud. He just gave away the entire production agent stack in 30 minutes. This is the talk that separates people deploying AI agents that actually scale from people whose agents break the moment they leave localhost. Here's everything inside. I break down a production AI video like this every week. Follow Himanshu Kumar. ↓ The 4-part agent stack that actually scales. Most devs are duct-taping frameworks together and calling it an "AI agent." Ivan lays out the real stack: Agent Development Kit (ADK): open-source, code-first framework for building, evaluating, and deploying agents. Supports Claude models through Vertex AI directly. Model Context Protocol (MCP): lets your agent talk to any tool or data source with one standard. Vertex AI Agent Engine: managed platform for deploying, monitoring, and scaling agents in production. No DevOps headaches. Agent-to-Agent Protocol: open protocol so agents built on different frameworks can actually work together. This is the stack replacing every hacky agent setup in production right now. Full MCP + Claude breakdowns drop weekly on Himanshu Kumar. ↓ Building your first real agent. Ivan builds a birthday planner agent live. LLM Agent class. Name it. Define instructions. Pick the model. He uses Claude 3.7 Sonnet. You could use Opus 4.7 for better reasoning. Full agent built in minutes. Not weeks. Watch the build once and you'll never structure an agent the wrong way again. I post agent architectures people pay $500 courses to learn. Himanshu Kumar. ↓ Multi-agent systems without the chaos. Single agents are easy. Multi-agent systems are where 99% of builders fail. Ivan extends the birthday planner by: Adding a calendar service through MCP tools Creating an orchestrator agent to route requests between agents Handling state and context across agent handoffs This is production multi-agent architecture. Clean. Scalable. Debuggable. Most tutorials hand-wave this part. This one shows you every step. Multi-agent orchestration content drops weekly on Himanshu Kumar. ↓ Deployment without the DevOps nightmare. This is where most AI projects die. You build a cool agent locally. It works. You try to deploy it. Everything breaks. Vertex AI Agent Engine fixes this: Minimal code deployment Automatic monitoring of latency, CPU, and memory Built-in observability and logging No infrastructure setup needed You provide config and requirements. The platform handles the rest. This is how agents actually get to production. Deployment guides for Claude agents post every week. Himanshu Kumar. ↓ Agent-to-Agent Protocol: the future nobody's talking about. Most people don't know this exists yet. The A2A Protocol lets agents built in different frameworks communicate seamlessly. Your Claude agent. My LangChain agent. Someone else's CrewAI agent. All talking to each other. All solving parts of the same problem. All without custom integration code. This is the infrastructure layer of the coming AI economy. Getting in early on A2A Protocol is like getting in early on HTTP in 1995. A2A deep dive coming soon. Himanshu Kumar. ↓ 30 minutes from the team shipping this in production. You'll learn more from this than from 6 months of YouTube tutorials made by people who've never deployed an agent past localhost. People who watch this understand production AI agents at the architect level. People who skip it keep hacking together frameworks that break every time an API updates. Save the video. Watch it tonight. Build a real agent this weekend. Follow Himanshu Kumar for more high-signal content that actually moves your AI engineering career forward.

Himanshu Kumar

229,473 views • 5 months ago