Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Research Update: WorldGen — Text to Immersive 3D Worlds

Reality Labs at Meta

33,680 subscribers

70,811 views • 8 months ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)

tamrat

133,830 views • 3 months ago

$DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline$

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 views • 2 years ago

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️

SpAItial AI

43,362 views • 2 months ago

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.

spark

84,725 views • 1 year ago

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

Min Choi

62,331 views • 6 months ago

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥

ElmonX

30,249 views • 3 years ago

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

79,533 views • 3 years ago

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.

World Labs

661,882 views • 6 months ago

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing

kalin

25,292 views • 21 days ago

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇

Fan-Yun Sun

35,981 views • 2 years ago

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.

el.cine

42,166 views • 1 year ago

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:

AK

121,020 views • 3 years ago

.Roblox CEO David Baszucki says immersive 3D is the next frontier in brand interactions, with people shopping together for both digital and physical items inside virtual worlds. $RBLX

After Earnings (from Morning Brew ☕️)

13,130 views • 1 year ago

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to million-scale with dense grounding. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

Jianing “Jed” Yang

27,626 views • 2 years ago

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

Matthias Niessner

19,005 views • 4 months ago

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

Min Choi

727,514 views • 6 months ago

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds

VRChat

38,147 views • 1 year ago

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,969 views • 2 years ago

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive 3D worlds from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 views • 3 months ago

text-to-animation for rigged 3D characters:

text-to-animation for rigged 3D characters:

Dreaming Tulpa 🥓👑

45,253 views • 1 year ago