Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Every open-source project should be engineering agent loops right now. We've found success managing Warp with loops for: - Issue triage - Spec generation for larger features - Code review - Even letting agents self-improve their Skills on a cron

41,258 görüntüleme • 4 ay önce •via X (Twitter)

25 Yorum

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

If you want a template, we also open-sourced our management framework. Still early and would love feedback on it: If you wanna set it up on your project, DM me! We can help with the token cost :)

Andrei Maxim profil fotoğrafı
Andrei Maxim4 ay önce

@warpdotdev That's not a loop. A cron job, callback, event listener are more accurate terms than "loop". Based on what you describe, you invoke the triage skill (or whatever skill you want) once per PR, hence not a loop.

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@warpdotdev Fair, expanded here

Andrei Maxim profil fotoğrafı
Andrei Maxim4 ay önce

The two loops described there are not loops: one is a callback and the other is a cron job. I don't think anyone would name either of those as a "loop". You could argue that it's a "loop" as in "feedback loop", but that case you'd need the output to be redirected back to the system, but this is not the case in either of those examples. I know it sounds like I'm nitpicking, but I truly do think that words matter and being accurate matters, especially when we live in a world where the natural language we use can produce significant chunks of code.

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@warpdotdev Eh, fine. I’ll agree to that

Akshay profil fotoğrafı
Akshay4 ay önce

@warpdotdev What exactly is the “loop” here ? Trying to understand how this is different from a multi agent system.

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@akshaydeshraj @warpdotdev The part that makes it a loop for us is self-improvement. We set up a few agents on schedules to evaluate GitHub comments on issues and PRs to see if our automations Skills can be improved. @zachlloydtweets expanded on our setup here:

Clifton Cunningham profil fotoğrafı
Clifton Cunningham4 ay önce

@warpdotdev I couldn't agree more! Here is mine for my open source projects (it is managing itself, and spec public):

Will Washburn profil fotoğrafı
Will Washburn4 ay önce

@warpdotdev yes, absolutely. I think the goal for OSS projects should be to make your repo slop proof by having a bunch of loop systems that correct / review / improve contributions

Max Howell profil fotoğrafı
Max Howell4 ay önce

@warpdotdev You should let it loop to remove all the bloat

Yunfei He profil fotoğrafı
Yunfei He4 ay önce

@warpdotdev /loop is the way.

Phi Browser profil fotoğrafı
Phi Browser4 ay önce

@warpdotdev Agent loops are the right direction. What makes them safe to actually let run is observability: watching the agent work, not just reading the diff after. The teams that win give the human a live view and a way to step in, not just an output to approve.

Dom Hallan profil fotoğrafı
Dom Hallan4 ay önce

@warpdotdev You lost me at "every" because there is few scenarios that realistically fit EVERY project.

dwi budi profil fotoğrafı
dwi budi4 ay önce

@warpdotdev What actually warp is? Coding agent or terminal? Drop a beginner video tutorial please.

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@warpdotdev Warp is a terminal to see what agents are doing, Oz is our automation platform to host agents on cloud runners if you need it. I made a getting started playlist on both here!

Ralf Kronen profil fotoğrafı
Ralf Kronen4 ay önce

@warpdotdev Most of those loops have a judge downstream. Triage, spec gen, a human reads it next. Code review is the odd one out: it grades the same kind of work that wrote the diff, and self-improving on a cron just tightens that circle. Which loop has a check the agent doesn't own?

Chungus profil fotoğrafı
Chungus4 ay önce

@warpdotdev

Mohamed Abdelgwad profil fotoğrafı
Mohamed Abdelgwad4 ay önce

@warpdotdev Hey Ben, what tool are u using for your videos? Can it work with streaming too?

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@warpdotdev @screenstudio !

Waves profil fotoğrafı
Waves4 ay önce

How are you measuring issue triage success rate? Its very common for teams to say “agent easily triaged a b c!!!” Based off a few cherry picked examples But never really scales once you are triaging 100s per day and it’s pretty easy to loose customer trust when your agent is wrong

Utsav Ladani profil fotoğrafı
Utsav Ladani4 ay önce

@warpdotdev My team is starting a new project. Looking forward to set this up for it, especially skills of this GH repo.

xeno_+ profil fotoğrafı
xeno_+4 ay önce

@warpdotdev you guys aren't seriously just starting on loops now, are you? I don't think I believe that.

Ben Holmes profil fotoğrafı
Ben Holmes4 ay önce

@warpdotdev Been doing it for months. Just using the vocab that's hip with the kids

Timur Yessenov profil fotoğrafı
Timur Yessenov4 ay önce

@warpdotdev This is the loop shape I trust: the agent changes the repo, then later reads real GitHub comments and updates the skill. The missing metric I’d track is simple: did the next run make the same mistake less often?

Fer profil fotoğrafı
Fer4 ay önce

A lot of open source projects do not use github, they use gitlab, gitea, codeberg, sourcehut, cgit and lots of other fully proper open source solutions for git so this is sadly not useful for a lot of older OSS projects, especially ones in the linux/bsd space. It would be nice to see this but a bit more vendor agnostic.

Benzer Videolar