Загрузка видео...

Не удалось загрузить видео

На главную

ImmerseGen Agent-Guided Immersive World Generation with Alpha-Textured Proxies

_akhaliq's profile picture

AK

415,004 subscribers

42,848 просмотров • 1 год назад •via X (Twitter)

Наука и технологииОбразование
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.
0:17

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.

MrNeRF

14,225 просмотров • 1 год назад

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation
0:11

🚨 TRELLIS.2 is now live on fal! 🎯 Image-to-3D model producing up to 1536³ PBR textured assets 🎨 Handles arbitrary topology with rich PBR textures (Base Color, Metallic, Roughness, Alpha) ⚡ 16× spatial compression for efficient, scalable, high-fidelity asset generation

fal

32,588 просмотров • 7 месяцев назад

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target
0:15

DRDO:Third Generation Fire & Forget Man Portable Anti-Tank Guided Missile (MPATGM) with top attack capability was flight tested successfully against moving target

War & Gore

12,112 просмотров • 6 месяцев назад

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:
0:07

With Hunyuan3D World Model 1.0 now released and open-sourced, we're excited to showcase the technical highlights behind this impressive innovation: ✅360° Panoramic Generation: Creates complete, immersive “world scenes”, far beyond localized views. ✅Explorable 3D Scene Generation: Generates diverse, spatially consistent 3D worlds from text/image for truly immersive exploration. ✅Interactive/Editable: Achieves separation of foreground objects, background terrain, ground, and sky, for seamless secondary editing. ✅Exportable Mesh: Generated scenes can be exported as 3D meshes for direct import into mainstream game engines and modeling software. ✅Industry-Leading SOTA Evaluation: Surpasses state-of-the-art open-source models in generation quality. As the industry's first open-source model for physical simulation and explorable world generation, Hunyuan3D World Model 1.0 aims to foster a collaborative community ecosystem with developers and enthusiasts. ✨ Try it now: 🤗 Hugging Face:

Tencent Hy

23,150 просмотров • 11 месяцев назад

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.
0:15

India today successfully flight-tested its third-generation Fire-and-Forget Man-Portable Anti-Tank Guided Missile (#MPATGM) with top-attack capability against a moving target.

Defence Decode®

16,383 просмотров • 6 месяцев назад

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇
0:19

Built a time machine powered by OpenAI’s new image generation model. Describe where and when you want to go, and it creates an immersive panoramic world you can explore. Just bring your API key. 👇

Pietro Schirano

95,492 просмотров • 2 месяцев назад

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):
0:20

Hello, world! It’s time for an #HourofCode adventure 🖥️ Learn the basics of coding with the trusty Agent to create helpful AI-powered inventions in the new Minecraft Hour of Code: Generation AI Start your coding journey here for free (no license required):

Minecraft

314,675 просмотров • 2 лет назад

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js
0:18

It’s crazy how a single image can turn into an immersive experience with World Labs. - 3D environment - Animated character + assets - Cursor / Spark 2.0 / three.js

Brittani Natali

11,723 просмотров • 2 месяцев назад

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY
0:10

⚡️ Artyfact AI Technologies: NPCs! ⚡️ 🤖 Artyfact will add the next generation of NPCs! Equipped with advanced AI technologies, they navigate the game world independently using complex algorithms, delivering truly immersive interactions in epic battles. 👾 Each NPC is unique, with its own rules and strategies, making every game unpredictable and full of new opportunities. #arty #artyfact $ARTY

Artyfact ⚡️

30,778 просмотров • 1 год назад

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI
0:18

The next frontier isn’t apps. It’s agents. Build, deploy, and profit from the next generation of AI with Skynet. The open network powering the agent economy. #AI

Skynet

23,282 просмотров • 9 месяцев назад

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration
0:10

KPR by Resn wins #SOTD & #DEVAWARD Enter New Eden, an immersive world brought to life with captivating art and storytelling. One world, two factions. Divided in belief, united in purpose. ↳ #Animation #Illustration

awwwards.

115,805 просмотров • 3 лет назад

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.
0:15

More than ever, this generation is awake, and unafraid to show the world they stand with justice and humanity.

𝓙𝓲𝓶𝓶𝔂 𝓙 🫒🗝️🇵🇸

23,383 просмотров • 1 год назад

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs
0:10

Sensitive content

Deck the halls with acts of submission! Footslaves, make this Christmas unforgettable by showering your master with tributes that resonate with holiday cheer. Kenya Escorts @Retweet4Masters The Findom Influencer AlphaAmplifier 💪🏻 Alpha Male World 🌎 Alpha zahir 7k👑 @certified_alphs

💸cash Nawab(3.5k) 💸💵

12,346 просмотров • 2 лет назад

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!
0:17

Catch Wan2.5 in action, redefining video generation with native multimodality and high-fidelity audio 🎧From lifelike human voices, to immersive ASMR, sound effects, and music, Wan2.5-preview brings synchronized audio to the forefront of storytelling!

Alibaba Group

92,063 просмотров • 9 месяцев назад

Krea is now built in to Hermes Agent as an image generation API provider, allowing your agent to use Krea 2: a new foundation model trained from scratch to balance aesthetic quality and fine control, with style transfer, moodboard input, and adjustable creativity settings.
0:19

Krea is now built in to Hermes Agent as an image generation API provider, allowing your agent to use Krea 2: a new foundation model trained from scratch to balance aesthetic quality and fine control, with style transfer, moodboard input, and adjustable creativity settings.

Nous Research

137,854 просмотров • 1 месяц назад

Elevate privacy and engagement with our AI agent network. Whispr adapts to your world—no accounts, just encrypted presence, with comprehensive docs. And on-chain agent reliability makes every connection verifiable and dependable. Whispr #Builders #Whispr #AIAgents #PrivateAI #Web3
0:17

Elevate privacy and engagement with our AI agent network. Whispr adapts to your world—no accounts, just encrypted presence, with comprehensive docs. And on-chain agent reliability makes every connection verifiable and dependable. Whispr #Builders #Whispr #AIAgents #PrivateAI #Web3

Whispr

10,767 просмотров • 4 месяцев назад

🌌 Alpha Gate: Your Free Mint Genesis Pass into an Ecosystem with $50 Million Invested. Alpha Gate is a collection of 515 NFTs that you do not want to miss out on. 🎟️ Raffling 1 WL Comment Alpha Gate and connect to Logistikos to qualify: 👇🏻 Space Nation, the Space Opera MMORPG, aims to introduce web2 users to the world of web3 gaming through immersive gameplay and captivating storytelling. Holders of an Alpha Gate will have • Early access to Space Nation Online and future games • Airdrop or whitelist of future Space Nation NFTs • Special privileges across online & offline activities • Exclusive in-game surprises! Become a Genesis NFT holder in an ecosystem created by experienced directors who have generated billions of dollars and veteran builders who have worked on global titles like World of Warcraft, Warframe, World of Tanks, and more. Are you interested in acquiring 1 of only 515 Alpha Gates Explorer? Enter "Alpha Gate" below and start your journey here:
0:15

🌌 Alpha Gate: Your Free Mint Genesis Pass into an Ecosystem with $50 Million Invested. Alpha Gate is a collection of 515 NFTs that you do not want to miss out on. 🎟️ Raffling 1 WL Comment Alpha Gate and connect to Logistikos to qualify: 👇🏻 Space Nation, the Space Opera MMORPG, aims to introduce web2 users to the world of web3 gaming through immersive gameplay and captivating storytelling. Holders of an Alpha Gate will have • Early access to Space Nation Online and future games • Airdrop or whitelist of future Space Nation NFTs • Special privileges across online & offline activities • Exclusive in-game surprises! Become a Genesis NFT holder in an ecosystem created by experienced directors who have generated billions of dollars and veteran builders who have worked on global titles like World of Warcraft, Warframe, World of Tanks, and more. Are you interested in acquiring 1 of only 515 Alpha Gates Explorer? Enter "Alpha Gate" below and start your journey here:

Space Nation 🛸

225,916 просмотров • 2 лет назад

Coin3D Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning As humans, we aspire to create media content that is both freely willed and readily controlled. Thanks to the prominent development of generative techniques, we now can easily utilize
0:16

Coin3D Controllable and Interactive 3D Assets Generation with Proxy-Guided Conditioning As humans, we aspire to create media content that is both freely willed and readily controlled. Thanks to the prominent development of generative techniques, we now can easily utilize

AK

23,055 просмотров • 2 лет назад

Play, earn, and experience the future of gaming with SOMO. From epic battles to rare items, SOMO is about to unlock a world of immersive experiences. It’s game on!
0:11

Play, earn, and experience the future of gaming with SOMO. From epic battles to rare items, SOMO is about to unlock a world of immersive experiences. It’s game on!

SOMO

29,016 просмотров • 1 год назад