Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Experimenting with image-to-world: creating consistent 3D environments from a single photo. As someone who studied architecture, this feels like a glimpse into the future of spatial creation and I’m excited to see where World Labs takes it.

XRarchitect's profile picture

Ian Curtis

22,729 subscribers

61,148 Aufrufe • vor 9 Monaten •via X (Twitter)

Wissenschaft & TechnologieBildungKunst
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Generating 3D Worlds from a Single Image AI can now turn any photo into a 3D world. World Labs AI creates spaces with an understanding of what it’s building, making it possible to add physics and place new objects inside. Explore here (World Labs demos): marble.worldlabs .ai
0:18

Generating 3D Worlds from a Single Image AI can now turn any photo into a 3D world. World Labs AI creates spaces with an understanding of what it’s building, making it possible to add physics and place new objects inside. Explore here (World Labs demos): marble.worldlabs .ai

Leon

89,924 Aufrufe • vor 8 Monaten

A short glimpse into the world of TORNBLADE. A few moments from the game as it takes shape. #indiedev #indiegame
0:14

A short glimpse into the world of TORNBLADE. A few moments from the game as it takes shape. #indiedev #indiegame

TORNBLADE game

66,564 Aufrufe • vor 4 Monaten

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”
0:18

Create a 3D model from a single image, set of images or a text prompt in < 1 minute 😮‍💨 This new AI paper called CAT3D shows us that it’ll keep getting easier to produce 3D models from 2D images — whether it’s a sparser real world 3D scan (a few photos instead of hundreds) or your favorite 2D image generator like Midjourney (just an image). How does this magic work? “This architecture is similar to video diffusion models, but with camera pose embeddings for each image instead of time embeddings. The generated views are passed into a robust 3D reconstruction pipeline to create the 3D representation (Zip-NeRF or 3DGS)”

Bilawal Sidhu

92,760 Aufrufe • vor 2 Jahren

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js
0:18

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js

Brittani Natali

11,723 Aufrufe • vor 27 Tagen

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.
0:12

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 Aufrufe • vor 1 Jahr

World Models are heating up as Prof. Fei-fei Li Fei-Fei Li's World Labs World Labs ignites the space with their first product Marble 🔥🌍 Riding that momentum, we’re launching a World Model demo on Theta Network EdgeCloud, powered by Tencent Tencent 腾讯's open-source Hunyuan 3D World Model, and packaged as a standard model template for creators, devs, and AI worldbuilders. Text/Image → explorable 3D worlds. Single image → full geometry. Exportable, editable, fast! Try it now:
0:11

World Models are heating up as Prof. Fei-fei Li Fei-Fei Li's World Labs World Labs ignites the space with their first product Marble 🔥🌍 Riding that momentum, we’re launching a World Model demo on Theta Network EdgeCloud, powered by Tencent Tencent 腾讯's open-source Hunyuan 3D World Model, and packaged as a standard model template for creators, devs, and AI worldbuilders. Text/Image → explorable 3D worlds. Single image → full geometry. Exportable, editable, fast! Try it now:

Jieyi Long | Theta Network

25,480 Aufrufe • vor 6 Monaten

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025
0:12

Bring new robot testing environments to life with World Labs and Isaac Sim. 🤖 If you can describe a world 🌎, you can start testing in it the same day. Learn how to: 1. Export scenes from World Labs' Marble as Gaussian splats 2. Convert to USD using NVIDIA Omniverse NuRec 3. Import into NVIDIA Isaac Sim 4. Add a robot and run the simulation Read the guide ➡️ #SIGGRAPHAsia2025

NVIDIA Robotics

157,393 Aufrufe • vor 5 Monaten

Been experimenting with a similar technique lately Midjourney —&gt; Gaussian Splat So cool to see this generative AI video to 3D workflow. Excited to see where it’s headed
0:14

Been experimenting with a similar technique lately Midjourney —&gt; Gaussian Splat So cool to see this generative AI video to 3D workflow. Excited to see where it’s headed

Ian Curtis

127,336 Aufrufe • vor 10 Monaten

Meta just dropped a new paper. "A Recipe for Generating 3D Worlds From a Single Image" Turn a single image into a high-quality 3D world ready for VR. 10 wild examples:
0:16

Meta just dropped a new paper. "A Recipe for Generating 3D Worlds From a Single Image" Turn a single image into a high-quality 3D world ready for VR. 10 wild examples:

Angry Tom

214,383 Aufrufe • vor 1 Jahr

It is now possible to create 360 equirectangular VR 8K seamless videos from a single image! 😃 Theoretically Media World Labs #aivideo #VR
0:10

It is now possible to create 360 equirectangular VR 8K seamless videos from a single image! 😃 Theoretically Media World Labs #aivideo #VR

Daniel Skaale

51,956 Aufrufe • vor 7 Monaten

The new Victoria VR website is live. We continue to evolve our journey with AI. Victoria VR is more than a virtual world, it’s an AI-driven platform where creation is powered by intelligence itself. Imagine writing a single sentence and watching it become a living world. AI generates the architecture. AI populates it with avatars. AI gives them memory, logic, and awareness. This is creation redefined, where generative AI meets virtual reality, and imagination meets execution. Welcome to the foundation layer of the immersive internet. Discover the new Victoria VR: Victoria VR, a world where anything is possible.
0:12

The new Victoria VR website is live. We continue to evolve our journey with AI. Victoria VR is more than a virtual world, it’s an AI-driven platform where creation is powered by intelligence itself. Imagine writing a single sentence and watching it become a living world. AI generates the architecture. AI populates it with avatars. AI gives them memory, logic, and awareness. This is creation redefined, where generative AI meets virtual reality, and imagination meets execution. Welcome to the foundation layer of the immersive internet. Discover the new Victoria VR: Victoria VR, a world where anything is possible.

Victoria VR

176,796 Aufrufe • vor 7 Monaten

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (Black Forest Labs) and Marble (World Labs). How it works 👇
0:15

New vibecode project: 3D world generation on your phone ✨ Take a photo of a room or space, and transform it into a new style. Then generate a world you can explore. Made in Cursor using two new APIs - Flux.2 Klein (Black Forest Labs) and Marble (World Labs). How it works 👇

Justine Moore

42,525 Aufrufe • vor 4 Monaten

Today, we released Lyra 2.0, a framework for generating persistent, explorable 3D worlds at scale, from NVIDIA Research. Generating large-scale, complex environments is difficult for AI models. Current models often “forget” what spaces look like and lose track of movement over time, causing objects to shift, blur, or appear inconsistent. This prevents them from creating the reliable 3D environments required for downstream simulations. Lyra 2.0 solves these issues by: ✅ Maintaining per-frame 3D geometry to retrieve past frames and establish spatial correspondences ✅ Using self-augmented training to correct its own temporal drifting. Lyra 2.0 turns an image into a 3D world you can walk through, look back, and drop a robot into for real-time rendering, simulation, and immersive applications. ➡️ Learn more: 📄 Read the paper:
0:15

Today, we released Lyra 2.0, a framework for generating persistent, explorable 3D worlds at scale, from NVIDIA Research. Generating large-scale, complex environments is difficult for AI models. Current models often “forget” what spaces look like and lose track of movement over time, causing objects to shift, blur, or appear inconsistent. This prevents them from creating the reliable 3D environments required for downstream simulations. Lyra 2.0 solves these issues by: ✅ Maintaining per-frame 3D geometry to retrieve past frames and establish spatial correspondences ✅ Using self-augmented training to correct its own temporal drifting. Lyra 2.0 turns an image into a 3D world you can walk through, look back, and drop a robot into for real-time rendering, simulation, and immersive applications. ➡️ Learn more: 📄 Read the paper:

NVIDIA AI Developer

433,232 Aufrufe • vor 1 Monat

.@spicyflowerhands This main challenge used only a promotional photo to model this virtual sculpture from a future world!! It showcases the design of an entire space for DEADLINE and LISA.
0:15

.@spicyflowerhands This main challenge used only a promotional photo to model this virtual sculpture from a future world!! It showcases the design of an entire space for DEADLINE and LISA.

LDN327

24,791 Aufrufe • vor 3 Monaten

What if you could turn a single 360° photo into a production-ready Isaac Sim environment in minutes? That's exactly what we did here. Using World Labs' Marble and an Insta360 X5 capture (rotating on top), we generated a complete navigable 3D environment and populated it with Lightwheel Sim Ready assets (bottom view). The result? A fully interactive scene in Isaac Sim, ready for sim2real testing,. Navigation, manipulation, or any robotics task you need to validate. What used to take weeks of manual 3D modeling and asset placement now takes minutes. Capture once in the real world, simulate everywhere in your training pipeline. This is the future of robotics development with world models. NVIDIA Robotics NVIDIA Omniverse #Sim2Real #Robotics #Simulation
0:15

What if you could turn a single 360° photo into a production-ready Isaac Sim environment in minutes? That's exactly what we did here. Using World Labs' Marble and an Insta360 X5 capture (rotating on top), we generated a complete navigable 3D environment and populated it with Lightwheel Sim Ready assets (bottom view). The result? A fully interactive scene in Isaac Sim, ready for sim2real testing,. Navigation, manipulation, or any robotics task you need to validate. What used to take weeks of manual 3D modeling and asset placement now takes minutes. Capture once in the real world, simulate everywhere in your training pipeline. This is the future of robotics development with world models. NVIDIA Robotics NVIDIA Omniverse #Sim2Real #Robotics #Simulation

Jonathan Stephens

46,338 Aufrufe • vor 5 Monaten

Experimenting with claymation today Kling AI 2.1 handing it like a champ. No prompt for this one I just put in the image to see where kling it would take it. More to come 😎👍
0:10

Experimenting with claymation today Kling AI 2.1 handing it like a champ. No prompt for this one I just put in the image to see where kling it would take it. More to come 😎👍

Captain HaHaa

42,576 Aufrufe • vor 1 Jahr

Someone just built a AI agent that connects to blender and builds full 3d models from a single image.
0:18

Someone just built a AI agent that connects to blender and builds full 3d models from a single image.

Oliver Prompts

53,398 Aufrufe • vor 1 Monat

I’m beyond excited and very proud to announce the first single of my upcoming album, called “The Realm”. This opening track of the album is an invitation. A doorway into the unknown, into this world I’ve been building through sound 🩶
0:17

I’m beyond excited and very proud to announce the first single of my upcoming album, called “The Realm”. This opening track of the album is an invitation. A doorway into the unknown, into this world I’ve been building through sound 🩶

Charlotte de Witte

20,773 Aufrufe • vor 1 Jahr

AI’s next frontier is Spatial Intelligence, a technology that will turn seeing into reasoning, perception into action, and imagination into creation. But what is it? Why does it matter? How do we build it? And how can we use it? Today, I want to share with you my thoughts on building and using world models to unlock spatial intelligence in this essay below. 1/n
0:11

AI’s next frontier is Spatial Intelligence, a technology that will turn seeing into reasoning, perception into action, and imagination into creation. But what is it? Why does it matter? How do we build it? And how can we use it? Today, I want to share with you my thoughts on building and using world models to unlock spatial intelligence in this essay below. 1/n

Fei-Fei Li

925,421 Aufrufe • vor 7 Monaten