Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Research Update: WorldGen — Text to Immersive 3D Worlds

RealityLabs's profile picture

Reality Labs at Meta

33,680 subscribers

70,811 görüntüleme • 8 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)
1:05

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)

tamrat

133,938 görüntüleme • 3 ay önce

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline
0:46

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 görüntüleme • 2 yıl önce

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️
0:28

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️

SpAItial AI

43,362 görüntüleme • 2 ay önce

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.
1:21

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.

spark

84,725 görüntüleme • 1 yıl önce

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin
0:59

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

Min Choi

62,331 görüntüleme • 6 ay önce

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥
0:59

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥

ElmonX

30,249 görüntüleme • 3 yıl önce

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at
0:22

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

79,533 görüntüleme • 3 yıl önce

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.
0:35

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.

World Labs

661,955 görüntüleme • 6 ay önce

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing
2:43

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing

kalin

25,292 görüntüleme • 25 gün önce

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇
0:32

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇

Fan-Yun Sun

35,981 görüntüleme • 2 yıl önce

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.
0:32

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.

el.cine

42,166 görüntüleme • 1 yıl önce

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:
0:42

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:

AK

121,020 görüntüleme • 3 yıl önce

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI
1:00

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

Jianing “Jed” Yang

27,626 görüntüleme • 2 yıl önce

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai
0:25

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

Matthias Niessner

19,005 görüntüleme • 4 ay önce

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯
0:57

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

Min Choi

727,743 görüntüleme • 6 ay önce

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds
0:43

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds

VRChat

38,147 görüntüleme • 1 yıl önce

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️
0:37

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,969 görüntüleme • 2 yıl önce

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:
1:04

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,581 görüntüleme • 4 ay önce

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.
0:40

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.

Wildminder

15,679 görüntüleme • 3 ay önce