正在加载视频...

视频加载失败

You should try using canvas-driven-development Since we're building 100x more features, that means you have 100x more QA but you can't try everything by hand so have your agents do it: write evals for how it should work, and put screenshots in a big canvas

10,866 次观看 • 3 天前 •via X (Twitter)

25 条评论

dotta 📎 的头像
dotta 📎3 天前

with Paperclip, we have to make sure our agents ask questions, write plans, save artifacts, create subtasks across dozens of models in various harnesses evals are the only way - but we're testing e2e and you want to have screenshots and the full chat when things go wrong

dotta 📎 的头像
dotta 📎3 天前

You aren't even testing specific outputs anymore, you're testing probability distributions

Andrew Warner 的头像
Andrew Warner3 天前

❤️❤️❤️

Enhans 的头像
Enhans3 天前

Screenshots in a canvas work because review scales by glance, while evals scale through explicit checks. The gap is what neither one catches: state that only breaks on the third run. How are you catching those today?

Chris Waldron 的头像
Chris Waldron1 天前

This looks awesome. I had built something similar for a website re-do. I am not a programmer by trade so most of these management systems are text heavy and i never want to look at them or read through. I like the idea of a visual decisions lane post testing

Jurly 的头像
Jurly3 天前

the canvas becomes a living regression suite for the whole product

AKLO 的头像
AKLO3 天前

Damn ur doin God's work

Mithushan Jalangan 的头像
Mithushan Jalangan2 天前

Works wonders, added support for PlanDesk ( for prototypes sams as canvas. Helps visualise flows and screens before hand and keeps iterations grounded.

dotta 📎 的头像
dotta 📎2 天前

neat

Robby 的头像
Robby3 天前

💪💪💪💪💪

🧩 David Turner 的头像
🧩 David Turner3 天前

How do you feel about using canvases? Building something that’s canvas based and it’s been hit or miss feedback.

dotta 📎 的头像
dotta 📎3 天前

This is just a one off to try to see all states at once and not really an IDE

🧩 David Turner 的头像
🧩 David Turner3 天前

Got it. If you find it interesting somehow, would love to hear more about it

homanp 的头像
homanp3 天前

Wow that’s very nice

Michael? 的头像
Michael?3 天前

Infinite canvas for infinite work

dotta 📎 的头像
dotta 📎3 天前

Feels that way sometimes

cobi 的头像
cobi3 天前

got a skill for this?

dotta 📎 的头像
dotta 📎3 天前

I'll publish one!

cobi 的头像
cobi2 天前

my dog!

Adam Dittrich 的头像
Adam Dittrich3 天前

the hardest part of building is knowing what’s worth shipping when ideas costs $0. taste becomes worthless if ai slop is the moat.

Adam Dittrich 的头像
Adam Dittrich2 天前

100% True love rick so much. exactly how i feel building ai systems as a non-coder 😊

Helmi 的头像
Helmi2 天前

I know what a canvas is, your video doesn't really show where the big benefit is though. How are you using them? This looks quite chaotic and hard to overlook. Are these iterations of one task? Is this just visual evidence for the tests an agent handled before?

Justin Miller 的头像
Justin Miller2 天前

This is my biggest bottleneck, 100X more QA that I can't trust anyone to do

nany.eth 的头像
nany.eth3 天前

canvas is just a UI trap

dotta 📎 的头像
dotta 📎3 天前

thirst trap

相关视频