Loading video...

Video Failed to Load

Go Home

You should try using canvas-driven-development Since we're building 100x more features, that means you have 100x more QA but you can't try everything by hand so have your agents do it: write evals for how it should work, and put screenshots in a big canvas

10,866 views • 2 days ago •via X (Twitter)

25 Comments

dotta 📎's profile picture
dotta 📎2 days ago

with Paperclip, we have to make sure our agents ask questions, write plans, save artifacts, create subtasks across dozens of models in various harnesses evals are the only way - but we're testing e2e and you want to have screenshots and the full chat when things go wrong

dotta 📎's profile picture
dotta 📎2 days ago

You aren't even testing specific outputs anymore, you're testing probability distributions

Andrew Warner's profile picture
Andrew Warner2 days ago

❤️❤️❤️

Enhans's profile picture
Enhans2 days ago

Screenshots in a canvas work because review scales by glance, while evals scale through explicit checks. The gap is what neither one catches: state that only breaks on the third run. How are you catching those today?

Chris Waldron's profile picture
Chris Waldron13 hours ago

This looks awesome. I had built something similar for a website re-do. I am not a programmer by trade so most of these management systems are text heavy and i never want to look at them or read through. I like the idea of a visual decisions lane post testing

Jurly's profile picture
Jurly2 days ago

the canvas becomes a living regression suite for the whole product

AKLO's profile picture
AKLO2 days ago

Damn ur doin God's work

Mithushan Jalangan's profile picture
Mithushan Jalangan1 day ago

Works wonders, added support for PlanDesk ( for prototypes sams as canvas. Helps visualise flows and screens before hand and keeps iterations grounded.

dotta 📎's profile picture
dotta 📎1 day ago

neat

Robby's profile picture
Robby2 days ago

💪💪💪💪💪

🧩 David Turner's profile picture
🧩 David Turner2 days ago

How do you feel about using canvases? Building something that’s canvas based and it’s been hit or miss feedback.

dotta 📎's profile picture
dotta 📎2 days ago

This is just a one off to try to see all states at once and not really an IDE

🧩 David Turner's profile picture
🧩 David Turner2 days ago

Got it. If you find it interesting somehow, would love to hear more about it

homanp's profile picture
homanp2 days ago

Wow that’s very nice

Michael?'s profile picture
Michael?2 days ago

Infinite canvas for infinite work

dotta 📎's profile picture
dotta 📎2 days ago

Feels that way sometimes

cobi's profile picture
cobi2 days ago

got a skill for this?

dotta 📎's profile picture
dotta 📎2 days ago

I'll publish one!

cobi's profile picture
cobi1 day ago

my dog!

Adam Dittrich's profile picture
Adam Dittrich2 days ago

the hardest part of building is knowing what’s worth shipping when ideas costs $0. taste becomes worthless if ai slop is the moat.

Adam Dittrich's profile picture
Adam Dittrich1 day ago

100% True love rick so much. exactly how i feel building ai systems as a non-coder 😊

Helmi's profile picture
Helmi1 day ago

I know what a canvas is, your video doesn't really show where the big benefit is though. How are you using them? This looks quite chaotic and hard to overlook. Are these iterations of one task? Is this just visual evidence for the tests an agent handled before?

Justin Miller's profile picture
Justin Miller1 day ago

This is my biggest bottleneck, 100X more QA that I can't trust anyone to do

nany.eth's profile picture
nany.eth2 days ago

canvas is just a UI trap

dotta 📎's profile picture
dotta 📎2 days ago

thirst trap

Related Videos