Загрузка видео...

Не удалось загрузить видео

На главную

Research Update: WorldGen — Text to Immersive 3D Worlds

RealityLabs's profile picture

Reality Labs at Meta

33,654 subscribers

70,827 просмотров • 9 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)
1:05

Introducing the mint mcp Your coding agent can now generate fully immersive 3D worlds and 3D models No Blender required :)

tamrat

135,494 просмотров • 4 месяцев назад

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline
0:46

DreamScene360 Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting The increasing demand for virtual reality applications has highlighted the significance of crafting immersive 3D assets. We present a text-to-3D 360^{circ} scene generation pipeline

AK

24,910 просмотров • 2 лет назад

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️
0:28

Introducing the SpAItial API to help you build immersive 3D worlds programmatically. You can now create world from text, image url, uploaded image, and 360 panorama with code. Track generation status, download results, export meshes and more. ⬇️

SpAItial AI

43,447 просмотров • 3 месяцев назад

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.
1:21

During the development of Spark, we built a demo to showcase the potential of using full scale AI generated 3D worlds as immersive VR environments.

spark

84,725 просмотров • 1 год назад

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin
0:59

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

Min Choi

62,357 просмотров • 7 месяцев назад

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥
0:59

Introducing ElmonX x ᴏɴᴄʏʙᴇʀ 3D and virtual reality immersive worlds 🌏 🥽 Exclusive spaces will be available to own as #NFTs 🔒 More details available in the coming months 🔥

ElmonX

30,249 просмотров • 3 лет назад

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at
0:22

What if #ChatGPT were 3D? Structure #GPT4's responses in 3D with #Sensecape to better understand large amounts of text. New Human-Computer Interaction #HCI research makes #AI easier to use. More at

Haijun Xia

79,533 просмотров • 3 лет назад

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.
0:35

The World API is live. Generate persistent, explorable 3D worlds from text, images, and video. Integrate them directly into your products.

World Labs

662,198 просмотров • 7 месяцев назад

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing
2:43

infinite sized worlds, endless adventures when worldgen is so fast its almost free, you can do interesting things going back to plain old C code is very freeing

kalin

25,445 просмотров • 1 месяц назад

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇
0:32

Our research introduces a system that enables you to generate 3D environments from text prompts and train embodied AI agents within them! Website: Code: How did we leverage Objaverse assets to create interactive 3D environments? 👇

Fan-Yun Sun

35,981 просмотров • 2 лет назад

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.
0:32

3D AI is advancing quicker than we ever thought possible. Right now, we can use it to create individual 3D assets, but soon, building entire virtual worlds with just a text prompt could become a reality. This is from Meta 3D AI team.

el.cine

42,166 просмотров • 1 год назад

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:
0:42

Dream3D: Zero-Shot Text-to-3D Synthesis Using 3D Shape Prior and Text-to-Image Diffusion Models abs: project page:

AK

121,020 просмотров • 3 лет назад

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI
1:00

🔥 3D-LLMs go brrrr! 🚀 Excited to announce our latest research on scaling 3D-LLM training data to *million-scale* with *dense grounding*. 🌟 Introducing 3D-GRAND: a pioneering dataset featuring 40,087 household scenes paired with 6.2 million densely-grounded 3D-text pairs. 🏠💬 #LLM #3D #AI #ML #Robotics #EmbodiedAI

Jianing “Jed” Yang

27,626 просмотров • 2 лет назад

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai
0:25

📢WorldAgents: 3D worlds only from 2D image models - without any training! We propose an agentic approach with a Director (VLM) to plan the scene, a Generator (Flux or NanoBanana) for new views, and a Verifier (VLM) for selection / 3D consistency. -> High-fidelity 3D worlds from a single text prompt. What's remarkable: our agents find consistent views from 2D image models to obtain 3D-consistent worlds; this shows that image models contain world priors - agents just need to find them! Great work by Ziya Erkoç Angela Dai

Matthias Niessner

19,020 просмотров • 5 месяцев назад

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯
0:57

It's happening... Google DeepMind is about to drop Genie 3 This AI can generate interactive 3D worlds with just text... And you can interact with objects in real time 🤯

Min Choi

727,743 просмотров • 7 месяцев назад

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds
0:43

Check out these worlds with Venice Immersive! #vrchat #vr #vrchatworlds

VRChat

38,147 просмотров • 2 лет назад

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️
0:37

We’re also publishing two research papers on the approaches we used for high quality 3D model generation & texture generation based on text prompts that are behind the Meta 3D Gen system. Meta 3D AssetGen ➡️ Meta 3D TextureGen ➡️

AI at Meta

72,973 просмотров • 2 лет назад

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:
1:04

We’re open-sourcing HY-World 2.0, a multimodal world model that generates, reconstructs, and simulates interactive *3D worlds* from text, images, and videos. Outputs can be integrated into game engines and embodied simulation pipelines. Key highlights: 🔹 One-click world generation Turn text or image into interactive 3D worlds automatically. 🔹 Pipeline-ready 3D outputs Editable 3D worlds for Unity and Unreal Engine, with standard 3D exports including mesh, 3DGS, and point clouds. 🔹 Unified world model system One model family for world generation and reconstruction across synthetic and real-world scenes. 🔹 Interactive character mode Explore generated 3D worlds in real time with physics-aware movement and collision support. ✨ Apply for access: 🔗 GitHub: 🤗 Hugging Face: 📄 Technical Report:

Tencent Hy

371,977 просмотров • 4 месяцев назад

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.
0:40

Map2World. turns text descriptions and sketch maps into full 3D worlds. -multi-diffusion in SLAT latent space for global consistency; - beaats SynCity - supports arbitrary world sizes.

Wildminder

15,679 просмотров • 3 месяцев назад