正在加载视频...
视频加载失败
Karpathy’s Agentic Engineering finally has proper DevTools! When an agent stops working, the model is only one possible cause. The problem could be a failed tool, a lost connection, an interface update that never appeared, or something earlier in the conversation. CopilotKit🪁 has rebuilt its open-source Inspector around this... show more
12,206 次观看 • 10 天前 •via X (Twitter)
13 条评论

@CopilotKit @akshay_pachaar Yeah, debugging those is a nightmare. Ran into similar issues when I was building my own thing. Learned to triple-check everything.

@CopilotKit Turning recurring runtime failures directly into proposed SKILL files is a brilliant way to close the eval loop.

@CopilotKit the replay from the exact state is probably the interesting part here.

@CopilotKit The "lost connection" case is the one that eats hours, because the agent just retries or silently gives up. Capturing the DOM and console at the moment of failure usually tells you more than the model's own reasoning trace.

@CopilotKit Agent debugging needs context, not just logs. This makes reproducing failures much easier.

@CopilotKit 🚀🚀

@CopilotKit Branching a conversation to the playground won't help if the failure was caused by external API side-effects that you can't actually roll back.

@CopilotKit tool returned 200, wrong field, nothing turned red for a week. does inspector catch a run that succeeds and is still wrong?

@CopilotKit Reproducing agent failures from the exact conversation state is a huge improvement for debugging.

@CopilotKit replaying the bug beats saying "do that weird thing again" while the agent invents a new failure.

@CopilotKit This is huge — finally real DevTools for agents that actually show _where_ it broke, not just that it broke!

@CopilotKit “Try from here” is the bit that caught my eye. Re-running the whole conversation and getting a completely different failure is a very special kind of debugging 😂

@CopilotKit 终于有人把 agent 抽风时到底哪儿坏了这件事摊开讲了
