Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Research Update: WorldGen — Text to Immersive 3D Worlds

RealityLabs's profile picture

Reality Labs at Meta

33,680 subscribers

70,811 Aufrufe • vor 8 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)
1:05

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)

tamrat

133,830 Aufrufe • vor 3 Monaten

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline
0:46

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 Aufrufe • vor 2 Jahren

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️
0:28

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️

SpAItial AI

43,362 Aufrufe • vor 2 Monaten

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.
1:21

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.

spark

84,725 Aufrufe • vor 1 Jahr

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin
0:59

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

Min Choi

62,331 Aufrufe • vor 6 Monaten

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥
0:59

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥

ElmonX

30,249 Aufrufe • vor 3 Jahren

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at
0:22

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

79,533 Aufrufe • vor 3 Jahren

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.
0:35

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.

World Labs

661,882 Aufrufe • vor 6 Monaten

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing
2:43

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing

kalin

25,292 Aufrufe • vor 21 Tagen

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇
0:32

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇

Fan-Yun Sun

35,981 Aufrufe • vor 2 Jahren

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.
0:32

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.

el.cine

42,166 Aufrufe • vor 1 Jahr

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:
0:42

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:

AK

121,020 Aufrufe • vor 3 Jahren

.Roblox CEO David Baszucki says immersive 3D is the next frontier in brand interactions, with people shopping together for both digital and physical items inside virtual worlds. $RBLX
1:02

.Roblox CEO David Baszucki says immersive 3D is the next frontier in brand interactions, with people shopping together for both digital and physical items inside virtual worlds. $RBLX

After Earnings (from Morning Brew ☕️)

13,130 Aufrufe • vor 1 Jahr

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI
1:00

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

Jianing “Jed” Yang

27,626 Aufrufe • vor 2 Jahren

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai
0:25

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

Matthias Niessner

19,005 Aufrufe • vor 4 Monaten

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯
0:57

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

Min Choi

727,514 Aufrufe • vor 6 Monaten

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds
0:43

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds

VRChat

38,147 Aufrufe • vor 1 Jahr

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️
0:37

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,969 Aufrufe • vor 2 Jahren

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:
1:04

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 Aufrufe • vor 3 Monaten

text-to-animation for rigged 3D characters:
0:28

text-to-animation for rigged 3D characters:

Dreaming Tulpa 🥓👑

45,253 Aufrufe • vor 1 Jahr