Loading video...

Video Failed to Load

Go Home

ImmerseGen Agent-Guided Immersive World Generation with Alpha-Textured Proxies

_akhaliq's profile picture

AK

415,004 subscribers

42,848 views • 1 year ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.
0:17

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.

MrNeRF

14,225 views • 1 year ago

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation
0:11

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation

fal

32,588 views • 5 months ago

Making of the Exverse Proxies. Proxies will be your link to the world of Exverse. Upload yourself here: #Exverse #ExverseAlpha
0:19

Making of the Exverse Proxies. Proxies will be your link to the world of Exverse. Upload yourself here: #Exverse #ExverseAlpha

EXVERSE

213,886 views • 2 years ago

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target
0:15

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target

War & Gore

12,112 views • 5 months ago

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,150 views • 10 months ago

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.
0:15

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.

Defence Decode®

16,383 views • 5 months ago

Generation „Alpha“ wünscht Ihnen eine chillige Woche.
0:25

Generation „Alpha“ wünscht Ihnen eine chillige Woche.

spaceloop23 🗽

13,625 views • 6 months ago

Textured white frosting with pink accents. Beautiful! cr. on Instagram/ namdarcake_naderpour
0:18

Textured white frosting with pink accents. Beautiful! cr. on Instagram/ namdarcake_naderpour

Iraa💤

10,882 views • 11 months ago

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇
0:19

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇

Pietro Schirano

95,293 views • 1 month ago

Making textured ceramics
0:16

Making textured ceramics

Science girl

900,297 views • 1 year ago

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):
0:20

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):

Minecraft

314,675 views • 2 years ago

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js
0:18

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js

Brittani Natali

11,723 views • 1 month ago

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY
0:10

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY

Artyfact ⚡️

30,767 views • 1 year ago

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI
0:18

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI

Skynet

23,282 views • 8 months ago

Woxic gets immersive with the dodges
0:16

Woxic gets immersive with the dodges

yeet

30,393 views • 6 months ago

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration
0:10

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration

awwwards.

115,805 views • 3 years ago

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.
0:15

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.

𝓙𝓲𝓶𝓶𝔂 𝓙 🫒🗝️🇵🇸

23,383 views • 11 months ago

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs
0:10

Sensitive content

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs

💸cash Nawab(3.5k) 💸💵

12,346 views • 2 years ago

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!
0:17

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!

Alibaba Group

92,063 views • 8 months ago