Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

ImmerseGen Agent-Guided Immersive World Generation with Alpha-Textured Proxies

_akhaliq's profile picture

AK

415,004 subscribers

42,848 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.
0:17

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.

MrNeRF

14,225 Aufrufe • vor 1 Jahr

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation
0:11

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation

fal

32,588 Aufrufe • vor 6 Monaten

Making of the Exverse Proxies. Proxies will be your link to the world of Exverse. Upload yourself here: #Exverse #ExverseAlpha
0:19

Making of the Exverse Proxies. Proxies will be your link to the world of Exverse. Upload yourself here: #Exverse #ExverseAlpha

EXVERSE

213,893 Aufrufe • vor 2 Jahren

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target
0:15

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target

War & Gore

12,112 Aufrufe • vor 5 Monaten

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,150 Aufrufe • vor 11 Monaten

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.
0:15

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.

Defence Decode®

16,383 Aufrufe • vor 5 Monaten

Textured white frosting with pink accents. Beautiful! cr. on Instagram/ namdarcake_naderpour
0:18

Textured white frosting with pink accents. Beautiful! cr. on Instagram/ namdarcake_naderpour

Iraa💤

10,882 Aufrufe • vor 1 Jahr

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇
0:19

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇

Pietro Schirano

95,492 Aufrufe • vor 2 Monaten

Making textured ceramics
0:16

Making textured ceramics

Science girl

900,297 Aufrufe • vor 1 Jahr

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):
0:20

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):

Minecraft

314,675 Aufrufe • vor 2 Jahren

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js
0:18

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js

Brittani Natali

11,723 Aufrufe • vor 2 Monaten

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY
0:10

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY

Artyfact ⚡️

30,778 Aufrufe • vor 1 Jahr

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI
0:18

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI

Skynet

23,282 Aufrufe • vor 9 Monaten

Woxic gets immersive with the dodges
0:16

Woxic gets immersive with the dodges

yeet

30,393 Aufrufe • vor 7 Monaten

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration
0:10

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration

awwwards.

115,805 Aufrufe • vor 3 Jahren

Hand-chiseled limestone textured surface!!!!
0:15

Hand-chiseled limestone textured surface!!!!

Interior Design Architecture

32,191 Aufrufe • vor 17 Tagen

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.
0:15

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.

𝓙𝓲𝓶𝓶𝔂 𝓙 🫒🗝️🇵🇸

23,383 Aufrufe • vor 1 Jahr

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs
0:10

Sensitive content

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs

💸cash Nawab(3.5k) 💸💵

12,346 Aufrufe • vor 2 Jahren

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!
0:17

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!

Alibaba Group

92,063 Aufrufe • vor 9 Monaten