正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Direct3D‑S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention

Dreaming Tulpa 🥓👑

54,900 subscribers

27,877 次观看 • 1 年前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Wow with new #iPhone15 Pro we’ll be able to record 3d spatial videos! #AppleEvent

Wow with new #iPhone15 Pro we’ll be able to record 3d spatial videos! #AppleEvent

iJustine

226,330 次观看 • 2 年前

🔥Spatial intelligence needs fast, *interactive* 3D world generation 🎮 — introducing WonderWorld: generating 3D scenes interactively following your movement and content requests, and see them in <10 seconds! 🧵1/6 Web: arXiv:

🔥Spatial intelligence needs fast, interactive 3D world generation 🎮 — introducing WonderWorld: generating 3D scenes interactively following your movement and content requests, and see them in <10 seconds! 🧵1/6 Web: arXiv:

Hong-Xing (Koven) Yu

169,120 次观看 • 1 年前

🔥Spatial intelligence requires world generation, and now we have the first comprehensive evaluation benchmark📏 for it! Introducing WorldScore: Unifying evaluation for 3D, 4D, and video models on world generation! 🧵1/7 Web: arxiv:

🔥Spatial intelligence requires world generation, and now we have the first comprehensive evaluation benchmark📏 for it! Introducing WorldScore: Unifying evaluation for 3D, 4D, and video models on world generation! 🧵1/7 Web: arxiv:

Hong-Xing (Koven) Yu

66,809 次观看 • 1 年前

"Spann3R: 3D Reconstruction with Spatial Memory" In a nutshell: DUSt3R strikes again! Paper: Project: Method ⬇️

"Spann3R: 3D Reconstruction with Spatial Memory" In a nutshell: DUSt3R strikes again! Paper: Project: Method ⬇️

MrNeRF

52,560 次观看 • 1 年前

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

DimensionX: Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion TL;DR: Create 3/4DGS from Video Diffusion Note: Some first inference code released (not all yet). Contributions (cited): • We present DimensionX, a novel framework for generating photorealistic 3D and 4D scenes from only a single image using controllable video diffusion. • We propose ST-Director, which decouples the spatial and temporal priors in video diffusion models by learning (spatial and temporal) dimension-aware modules with our curated datasets. We further enhance the hybriddimension control with a training-free composition approach according to the essence of video diffusion denoising process. • To bridge the gap between video diffusion and real-world scenes, we design a trajectory-aware mechanism for 3D generation and an identity-preserving denoising approach for 4D generation, enabling more realistic and controllable scene synthesis. • Extensive experiments manifest that our DimensionX delivers superior performance in video, 3D, and 4D generation compared with baseline methods.

MrNeRF

17,039 次观看 • 1 年前

Cleaning Made Easy With This Genius Tool

Cleaning Made Easy With This Genius Tool

Agronomme Jean Baptiste🇬🇦 🌽🥦

11,739 次观看 • 1 个月前

This handy print makes magnet installation much easier! Made with: ELEGOO #CentauriCarbon 3D printer 3D model from: HX8 3D Design

This handy print makes magnet installation much easier! Made with: ELEGOO #CentauriCarbon 3D printer 3D model from: HX8 3D Design

ELEGOO

25,363 次观看 • 7 个月前

Metal Repair Made Easy with This Magic Sealant

Metal Repair Made Easy with This Magic Sealant

Chill_Broken

1,488,674 次观看 • 8 个月前

Long drives made easy with thot b!txh

Long drives made easy with thot b!txh

Midnighthugo

11,266 次观看 • 1 年前

Exploring !Boring stickers! in 3D, made with Omma AI.

Exploring !Boring stickers! in 3D, made with Omma AI.

Gábor Pribék

276,080 次观看 • 1 个月前

hunting ghosts not made in 3D, but with AI

hunting ghosts not made in 3D, but with AI

INK

49,788 次观看 • 5 个月前

Foldable donut made with Easy vertex anim plugin #UE5

Foldable donut made with Easy vertex anim plugin #UE5

Inu Games

61,916 次观看 • 8 个月前

iMac G3 icon - literally made with liquid 3D 🍎💧

iMac G3 icon - literally made with liquid 3D 🍎💧

Womp

25,692 次观看 • 1 年前

crazy.. AI made 3D Pixar animation with just one prompt

crazy.. AI made 3D Pixar animation with just one prompt

el.cine

3,478,221 次观看 • 2 个月前

You’ll be able to watch the WWDC livestream on Apple Vision Pro with spatial backdrops, interactive 3D models and the ability to post reactions in real-time. Source: Scenery

You’ll be able to watch the WWDC livestream on Apple Vision Pro with spatial backdrops, interactive 3D models and the ability to post reactions in real-time. Source: Scenery

Nathie

14,757 次观看 • 1 年前

Beautiful WebGPU render made with ThreeJS using a 3D attractor formula

Beautiful WebGPU render made with ThreeJS using a 3D attractor formula

Tommyedz ΑΩ

33,687 次观看 • 1 年前

Having trouble with posing characters? Draw with 3D models! ✅ Accurate poses & easy to move angles ✅ Quick tracing by line extraction Check out 3D assets for webtoons on ACON3D

Having trouble with posing characters? Draw with 3D models! ✅ Accurate poses & easy to move angles ✅ Quick tracing by line extraction Check out 3D assets for webtoons on ACON3D

에이콘

3,188,284 次观看 • 3 年前

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

Wonderland: Navigating 3D Scenes from a Single Image Contributions: • First, we introduce a representation for controllable 3D generation by leveraging the generative priors from camera-guided video diffusion models. Unlike image models, video diffusion models are trained on extensive video datasets. This enables them to capture comprehensive spatial relationships within scenes across multiple views and embed a form of "3D awareness" in their latent space, which allows us to maintain 3D consistency in novel view synthesis. • Second, to achieve controllable novel view generation, we empower video models with precise control over specified camera motions. We introduce a novel dual-branch conditioning mechanism that effectively incorporates desired diverse camera trajectories into the video diffusion model. This enables expansion of a single image into a multi-view consistent capture of a 3D scene with precise pose control. • Third, to achieve efficient 3D reconstruction, we directly transform video latents into 3DGS. We propose a novel latent-based large reconstruction model (LaLRM) that lifts video latents to 3D in a feed-forward manner. With this design, during inference, our model directly predicts 3DGS from a single input image, effectively aligning the generation and reconstruction tasks—and bridging image space and 3D space—through the video latent space. Compared with reconstructing scenes from images, the video latent space offers a 256× spatial-temporal reduction while retaining essential and consistent 3D structural details. Such a high degree of compression is crucial, as it allows the LaLRM to handle a wider range of 3D scenes within the reconstruction framework, with the same memory constraints.

MrNeRF

52,801 次观看 • 1 年前

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.

ImmerseGen: Agent-Guided Immersive World Generation with Alpha-Textured Proxies Contributions: 1) We propose ImmerseGen, a novel agent-guided 3D environment generation framework. It uses simplified geometric proxies with alpha-textured meshes to produce compact, photorealistic worlds ready for real-time mobile VR rendering. 2) We propose a novel RGBA texturing paradigm. It first synthesizes 8K terrain textures using a geometry-conditioned panorama generator via user-centric mapping, and then directly generates alpha-textured proxy assets, avoiding fidelity loss typically resulting from mesh decimation. 3) To automate scene creation from user prompts, we introduce VLM-based modeling agents equipped with a novel grid-based semantic analysis. This enables 3D spatial reasoning from 2D observations and ensures accurate asset placement. ImmerseGen further enhances immersion with dynamic effects and ambient audio for a multisensory experience. 4) Experiments on multiple scene-generation scenarios and live mobile VR applications show that ImmerseGen outperforms previous methods in visual quality, realism, spatial coherence, and rendering efficiency for immersive real-time VR experiences.

MrNeRF

14,225 次观看 • 1 年前