Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

You should try using canvas-driven-development Since we're building 100x more features, that means you have 100x more QA but you can't try everything by hand so have your agents do it: write evals for how it should work, and put screenshots in a big canvas

10,866 Aufrufe • vor 2 Tagen •via X (Twitter)

25 Kommentare

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

with Paperclip, we have to make sure our agents ask questions, write plans, save artifacts, create subtasks across dozens of models in various harnesses evals are the only way - but we're testing e2e and you want to have screenshots and the full chat when things go wrong

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

You aren't even testing specific outputs anymore, you're testing probability distributions

Profilbild von Andrew Warner
Andrew Warnervor 2 Tagen

❤️❤️❤️

Profilbild von Enhans
Enhansvor 2 Tagen

Screenshots in a canvas work because review scales by glance, while evals scale through explicit checks. The gap is what neither one catches: state that only breaks on the third run. How are you catching those today?

Profilbild von Chris Waldron
Chris Waldronvor 13 Stunden

This looks awesome. I had built something similar for a website re-do. I am not a programmer by trade so most of these management systems are text heavy and i never want to look at them or read through. I like the idea of a visual decisions lane post testing

Profilbild von Jurly
Jurlyvor 2 Tagen

the canvas becomes a living regression suite for the whole product

Profilbild von AKLO
AKLOvor 2 Tagen

Damn ur doin God's work

Profilbild von Mithushan Jalangan
Mithushan Jalanganvor 1 Tag

Works wonders, added support for PlanDesk ( for prototypes sams as canvas. Helps visualise flows and screens before hand and keeps iterations grounded.

Profilbild von dotta 📎
dotta 📎vor 1 Tag

neat

Profilbild von Robby
Robbyvor 2 Tagen

💪💪💪💪💪

Profilbild von 🧩 David Turner
🧩 David Turnervor 2 Tagen

How do you feel about using canvases? Building something that’s canvas based and it’s been hit or miss feedback.

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

This is just a one off to try to see all states at once and not really an IDE

Profilbild von 🧩 David Turner
🧩 David Turnervor 2 Tagen

Got it. If you find it interesting somehow, would love to hear more about it

Profilbild von homanp
homanpvor 2 Tagen

Wow that’s very nice

Profilbild von Michael?
Michael?vor 2 Tagen

Infinite canvas for infinite work

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

Feels that way sometimes

Profilbild von cobi
cobivor 2 Tagen

got a skill for this?

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

I'll publish one!

Profilbild von cobi
cobivor 1 Tag

my dog!

Profilbild von Adam Dittrich
Adam Dittrichvor 2 Tagen

the hardest part of building is knowing what’s worth shipping when ideas costs $0. taste becomes worthless if ai slop is the moat.

Profilbild von Adam Dittrich
Adam Dittrichvor 1 Tag

100% True love rick so much. exactly how i feel building ai systems as a non-coder 😊

Profilbild von Helmi
Helmivor 1 Tag

I know what a canvas is, your video doesn't really show where the big benefit is though. How are you using them? This looks quite chaotic and hard to overlook. Are these iterations of one task? Is this just visual evidence for the tests an agent handled before?

Profilbild von Justin Miller
Justin Millervor 1 Tag

This is my biggest bottleneck, 100X more QA that I can't trust anyone to do

Profilbild von nany.eth
nany.ethvor 2 Tagen

canvas is just a UI trap

Profilbild von dotta 📎
dotta 📎vor 2 Tagen

thirst trap

Ähnliche Videos