正在加载视频...
视频加载失败
enigmatic_e shows how our models fill a gap in his creative workflow, making it easy to stage characters within scenes and direct precise camera movements. 8/n
35,044 次观看 • 1 年前 •via X (Twitter)
14 条评论

We’ve been busy building an AI system to generate 3D worlds from a single image. Check out some early results on our site, where you can interact with our scenes directly in the browser! 1/n

World Labs aims to address the challenges many creators face with existing genAI models: a lack of control and consistency. Given an input image, our system estimates 3D geometry, fills in unseen parts of the scene, invents new content so you can turn around, and generalizes to a wide variety of scene types and artistic styles. 2/n

Our output 3D scenes can be rendered in real-time in the browser with full camera control. This means you can explore them with a freely moving camera like in a videogame, or even simulate 3D camera effects like shallow depth of field or dolly zoom. 3/n

Most generative models predict pixels. Predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. The simplest way to visualize the 3D scene is a depth map, where each pixel is colored by its distance to the camera. 4/n

Generating consistent 3D geometry allows us to interact with the scene in 3D-aware ways, like changing the scene’s lighting and appearance, modifying the geometry, or inserting other objects into the scene. 5/n

We also had some fun peeking into the worlds behind a few creative masterpieces, like the neighborhood surrounding the diner in Edward Hopper’s iconic painting Nighthawks. 6/n

3D world generation naturally composes with other AI tools. This allows creators to work with tools they already know to enable new experiences. We've given a few creators an early sneak peek at our technology to begin experimenting with the possibilities enabled by a 3D-native generative AI workflow. 7/n

This is just a glimpse into the future of 3D native generative AI – we’re working hard to put this tech into users’ hands as soon as possible! Stay tuned for future releases by signing up at or get in touch directly at [email protected]. n/n

@8bit_e @8bit_e 👑

@8bit_e Let’s gooo @8bit_e 💪🏽

@8bit_e absolutely fuckin insane

@8bit_e @BlockadeLabs You have very good 3D environment generate but I wish you can make that to real 3D like this

@8bit_e Is that real??? Fully explorable world model in unity or something??

@8bit_e Stop using X, switch to Bluesky too

