正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

InsertAnywhere Bridging 4D Scene Geometry and Diffusion Models for Realistic Video Object Insertion

AK

450,730 subscribers

26,123 次观看 • 10 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Google Deepmind presents CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models

Google Deepmind presents CAT4D: Create Anything in 4D with Multi-View Video Diffusion Models

Chubby♨️

12,843 次观看 • 1 年前

We’ve upgraded Stable Video Diffusion 4D to Stable Video 4D 2.0 (SV4D 2.0), improving the quality of 4D outputs generated from a single object-centric video. While 3D provides a static view of an object’s shape and size; 4D extends this by including time, showing how the object moves. This multi-view video diffusion model generates a 4D output in three steps: 1️⃣ Starts with an input video of a moving person or object 2️⃣ Generates novel views of the subject from unseen angles 3️⃣ Constructs a single dynamic 4D video output with spatial and temporal consistency You can learn more here: (1/4)

We’ve upgraded Stable Video Diffusion 4D to Stable Video 4D 2.0 (SV4D 2.0), improving the quality of 4D outputs generated from a single object-centric video. While 3D provides a static view of an object’s shape and size; 4D extends this by including time, showing how the object moves. This multi-view video diffusion model generates a 4D output in three steps: 1️⃣ Starts with an input video of a moving person or object 2️⃣ Generates novel views of the subject from unseen angles 3️⃣ Constructs a single dynamic 4D video output with spatial and temporal consistency You can learn more here: (1/4)

Stability AI

36,110 次观看 • 1 年前

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

🚀 Introducing DiffusionRenderer, a neural rendering engine powered by video diffusion models. 🎥 Estimates high-quality geometry and materials from videos, synthesizes photorealistic light transport, enables relighting and material editing with realistic shadows and reflections

Zian Wang

125,631 次观看 • 1 年前

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models

AK

131,358 次观看 • 2 年前

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:

AK

87,852 次观看 • 3 年前

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

Diffuman4D 4D Consistent Human View Synthesis from Sparse-View Videos with Spatio-Temporal Diffusion Models

AK

12,518 次观看 • 1 年前

A video is compressed 4D data. 🌍 Today, we’re sharing a preview of our latest research: 4D reconstruction from a single monocular video. 🎬 From one casually captured video, our system reconstructs a dynamic, freely viewable 4D Gaussian scene—recovering geometry, appearance, camera motion, and object motion across space and time. No multi-camera rig. Just video → 4DGS. The world has already been captured in video. The next step is to unlock the 4D structure inside it. Watch the result below. 👇 #4DGS #GaussianSplatting #CVPR #CVPR2026 #AIGC #AI #3DGS

A video is compressed 4D data. 🌍 Today, we’re sharing a preview of our latest research: 4D reconstruction from a single monocular video. 🎬 From one casually captured video, our system reconstructs a dynamic, freely viewable 4D Gaussian scene—recovering geometry, appearance, camera motion, and object motion across space and time. No multi-camera rig. Just video → 4DGS. The world has already been captured in video. The next step is to unlock the 4D structure inside it. Watch the result below. 👇 #4DGS #GaussianSplatting #CVPR #CVPR2026 #AIGC #AI #3DGS

InSpatio｜影溯

64,926 次观看 • 3 个月前

DimensionX Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion

DimensionX Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion

AK

58,273 次观看 • 2 年前

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

An Object is Worth 64x64 Pixels: Generating 3D Object via Image Diffusion discuss: We introduce a new approach for generating realistic 3D models with UV maps through a representation termed "Object Images." This approach encapsulates surface geometry, appearance, and patch structures within a 64x64 pixel image, effectively converting complex 3D shapes into a more manageable 2D format. By doing so, we address the challenges of both geometric and semantic irregularity inherent in polygonal meshes. This method allows us to use image generation models, such as Diffusion Transformers, directly for 3D shape generation. Evaluated on the ABO dataset, our generated shapes with patch structures achieve point cloud FID comparable to recent 3D generative models, while naturally supporting PBR material generation.

AK

66,769 次观看 • 2 年前

Dream2Flow Bridging Video Generation and Open-World Manipulation with 3D Object Flow

Dream2Flow Bridging Video Generation and Open-World Manipulation with 3D Object Flow

AK

29,980 次观看 • 10 个月前

Come check out V-DPM #CVPR2026 [Poster 25] 11:45 - 13:45 4D video reconstruction in the wild: code and models available 🤖 Eldar Insafutdinov Visual Geometry Group (VGG)

Come check out V-DPM #CVPR2026 [Poster 25] 11:45 - 13:45 4D video reconstruction in the wild: code and models available 🤖 Eldar Insafutdinov Visual Geometry Group (VGG)

Edgar Sucar

18,176 次观看 • 4 个月前

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,794 次观看 • 2 年前

Zhou et al., "PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception" VGGT extended to dynamic scenes with a dynamic mask predictor.

Zhou et al., "PAGE-4D: Disentangled Pose and Geometry Estimation for 4D Perception" VGGT extended to dynamic scenes with a dynamic mask predictor.

Kwang Moo Yi

11,546 次观看 • 1 年前

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Check out Christian Diller's CG-HOI :) We generate realistic 3D human-object interactions, from object geometry and text description. A key ingredient is explicit modeling of contact, during training and as guidance during inference.

Angela Dai

20,520 次观看 • 2 年前

Feature4X Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields

Feature4X Bridging Any Monocular Video to 4D Agentic AI with Versatile Gaussian Feature Fields

AK

13,934 次观看 • 1 年前

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation

RynnWorld-4D 4D Embodied World Models for Robotic Manipulation

AK

33,467 次观看 • 3 个月前

VerseCrafter Dynamic Realistic Video World Model with 4D Geometric Control

VerseCrafter Dynamic Realistic Video World Model with 4D Geometric Control

AK

27,430 次观看 • 9 个月前

If you look at the best image/video diffusion models, they are still not able to get the hands quite right, especially when interacting with objects ✍️ We present HOIDiffusion #CVPR2024, a way to generate accurate and realistic hand-object interaction images, in diverse poses, scenes, and styles. This is not just for synthesizing beautiful pixels, but also a way to generate infinite pairs of hand-object images and 3D GTs data.

If you look at the best image/video diffusion models, they are still not able to get the hands quite right, especially when interacting with objects ✍️ We present HOIDiffusion #CVPR2024, a way to generate accurate and realistic hand-object interaction images, in diverse poses, scenes, and styles. This is not just for synthesizing beautiful pixels, but also a way to generate infinite pairs of hand-object images and 3D GTs data.

Xiaolong Wang

33,673 次观看 • 2 年前