Loading video...

Video Failed to Load

Go Home

we built Cursor for 3D modeling.

1,262,188 views • 1 year ago •via X (Twitter)

11 Comments

martin's profile picture
martin1 year ago

what if you could turn your roughest sketches into not just 3D models, but entire 3D scenes? sketch freely on an infinite 2D canvas, and Vibe Draw will intelligently create polished, colorful 3D models.

martin's profile picture
martin1 year ago

then, you can rearrange the models in an infinite 3D world, to form a scene that you can export as a glTF file.

martin's profile picture
martin1 year ago

more features! - Turn text prompts into 3D models directly - Improve your sketches in one click, using AI to refine them while maintaining their spatial composition - Edit created 3D models by sketching over them or by adding a text prompt - Interact with individual objects in complex generated models (ex. individual trees in a forest) - Fully compatible with iPad + Apple Pencil

martin's profile picture
martin1 year ago

built with Osher Ahn-Clifford, @_williamzeng, and @__faastcall in 36 hours. winner of Canada's largest AI hackathon, GenAI Genesis!

martin's profile picture
martin1 year ago

GitHub: Devpost:

0xRetroDev's profile picture
0xRetroDev1 year ago

That's really cool guys! As a game developer tooling like this is super valuable for MVPs. I built a similar tooling, however using text instead of images for @unity and web. I'm going to take a wild poke and say this was done with @TencentGlobal's 3D model? Great work again! :)

martin's profile picture
martin1 year ago

@unity @TencentGlobal very cool project! we used claude sonnet 3.7 for the "regular" 3d generation (since we had to be quick for live demos), and trellis for the "advanced" mode

tldraw's profile picture
tldraw1 year ago

We gotta bump the tldraw version on the make real starter

lakshay bhushan's profile picture
lakshay bhushan1 year ago

That's so cool!! I also created an SVG to 3D converter:

MissingAFew's profile picture
MissingAFew1 year ago

>Claude Sonnet 3.7 allowed us to effectively prompt Three.js with images and text, dynamically generating accurate 3D models. So... can claude generate 3D models? Ive never really tried this. How exactly does this work, does it UV map and texture as well?

martin's profile picture
martin1 year ago

you can generate three.js code (just like with any other code), which can be directly rendered on browser or exported as .glTF models. no uv map/texture though

Related Videos