✨ draw and build a web app on your phone with AI

it’s a SwiftUI app that uses PencilKit and GPT-4 Vision to convert your drawing into HTML grab the code →

behind the scenes

you can also try drawing a UI in @figma using the code here

ported over to visionOS

How much is it really being guided by the drawing? Buttons are not in the same place, plenty of buttons not drawn are there. Great idea and I think it will work but I’m dubious of this demo

another example, no custom prompt

I think it completely ignored your drawing and guided itself by one word "calculator", giving you, yes, a default calculator

could you compare with results if you just drew a box? Or drew nothing and used the calculator title prompt alone? I think there are certain ui patterns that can do blind (clock, calculator)

yeah, "calculator" as a prompt and empty drawing results in an okay calculator see this for example with no prompt where the drawing is important:

"calculator" is the new "hello world" of code generation models