正在加载视频...

视频加载失败

You should try using canvas-driven-development Since we're building 100x more features, that means you have 100x more QA but you can't try everything by hand so have your agents do it: write evals for how it should work, and put screenshots in a big canvas

10,840 次观看 • 2 天前 •via X (Twitter)

25 条评论

dotta 📎 的头像
dotta 📎2 天前

with Paperclip, we have to make sure our agents ask questions, write plans, save artifacts, create subtasks across dozens of models in various harnesses evals are the only way - but we're testing e2e and you want to have screenshots and the full chat when things go wrong

dotta 📎 的头像
dotta 📎2 天前

You aren't even testing specific outputs anymore, you're testing probability distributions

Andrew Warner 的头像
Andrew Warner2 天前

❤️❤️❤️

Enhans 的头像
Enhans2 天前

Screenshots in a canvas work because review scales by glance, while evals scale through explicit checks. The gap is what neither one catches: state that only breaks on the third run. How are you catching those today?

Chris Waldron 的头像
Chris Waldron12 小时前

This looks awesome. I had built something similar for a website re-do. I am not a programmer by trade so most of these management systems are text heavy and i never want to look at them or read through. I like the idea of a visual decisions lane post testing

Jurly 的头像
Jurly2 天前

the canvas becomes a living regression suite for the whole product

AKLO 的头像
AKLO2 天前

Damn ur doin God's work

Mithushan Jalangan 的头像
Mithushan Jalangan1 天前

Works wonders, added support for PlanDesk ( for prototypes sams as canvas. Helps visualise flows and screens before hand and keeps iterations grounded.

dotta 📎 的头像
dotta 📎1 天前

neat

Robby 的头像
Robby2 天前

💪💪💪💪💪

🧩 David Turner 的头像
🧩 David Turner2 天前

How do you feel about using canvases? Building something that’s canvas based and it’s been hit or miss feedback.

dotta 📎 的头像
dotta 📎2 天前

This is just a one off to try to see all states at once and not really an IDE

🧩 David Turner 的头像
🧩 David Turner2 天前

Got it. If you find it interesting somehow, would love to hear more about it

homanp 的头像
homanp2 天前

Wow that’s very nice

Michael? 的头像
Michael?2 天前

Infinite canvas for infinite work

dotta 📎 的头像
dotta 📎2 天前

Feels that way sometimes

cobi 的头像
cobi2 天前

got a skill for this?

dotta 📎 的头像
dotta 📎2 天前

I'll publish one!

cobi 的头像
cobi1 天前

my dog!

Adam Dittrich 的头像
Adam Dittrich2 天前

the hardest part of building is knowing what’s worth shipping when ideas costs $0. taste becomes worthless if ai slop is the moat.

Adam Dittrich 的头像
Adam Dittrich1 天前

100% True love rick so much. exactly how i feel building ai systems as a non-coder 😊

Helmi 的头像
Helmi1 天前

I know what a canvas is, your video doesn't really show where the big benefit is though. How are you using them? This looks quite chaotic and hard to overlook. Are these iterations of one task? Is this just visual evidence for the tests an agent handled before?

Justin Miller 的头像
Justin Miller1 天前

This is my biggest bottleneck, 100X more QA that I can't trust anyone to do

nany.eth 的头像
nany.eth2 天前

canvas is just a UI trap

dotta 📎 的头像
dotta 📎2 天前

thirst trap

相关视频