Loading video...

Video Failed to Load

Go Home

DimensionX Create Any 3D and 4D Scenes from a Single Image with Controllable Video Diffusion

_akhaliq's profile picture

AK

519,876 subscribers

58,273 views • 1 year ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

5 Comments

AK's profile picture
AK1 year ago

discuss:

AK's profile picture
AK1 year ago

app:

A.I.Warper's profile picture
A.I.Warper1 year ago

Werking! 🤣

Awtriphop🎶's profile picture
Awtriphop🎶1 year ago

BROOO Where I can try this!!???? This is insane

Madan Khadka's profile picture
Madan Khadka1 year ago

LFG🚀, Great paper

Related Videos

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥
0:43

This is amazing! You can now create high-quality 3D Scenes from a single image using Multi-Instance Diffusion Models (MIDI) 🔥

Gradio

41,940 views • 1 year ago

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:
0:22

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

AK

163,868 views • 3 years ago

We’ve upgraded Stable Video Diffusion 4D to Stable Video 4D 2.0 (SV4D 2.0), improving the quality of 4D outputs generated from a single object-centric video. While 3D provides a static view of an object’s shape and size; 4D extends this by including time, showing how the object moves. This multi-view video diffusion model generates a 4D output in three steps: 1️⃣ Starts with an input video of a moving person or object 2️⃣ Generates novel views of the subject from unseen angles 3️⃣ Constructs a single dynamic 4D video output with spatial and temporal consistency You can learn more here: (1/4)
0:30

We’ve upgraded Stable Video Diffusion 4D to Stable Video 4D 2.0 (SV4D 2.0), improving the quality of 4D outputs generated from a single object-centric video. While 3D provides a static view of an object’s shape and size; 4D extends this by including time, showing how the object moves. This multi-view video diffusion model generates a 4D output in three steps: 1️⃣ Starts with an input video of a moving person or object 2️⃣ Generates novel views of the subject from unseen angles 3️⃣ Constructs a single dynamic 4D video output with spatial and temporal consistency You can learn more here: (1/4)

Stability AI

36,041 views • 1 year ago

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion
2:10

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion

AK

194,605 views • 2 years ago

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →
1:11

Introducing Cube 2.0, a significant step towards controllable 3D game-world and video generation from any input. Powered by: 🌟 Image-to-3D in seconds w/ a new foundation model 🐎 Text-to-animation 🌎 AI rendering to create beautiful worlds (mesh+splats) Web app → Discord → Blog →

Common Sense Machines

411,413 views • 2 years ago

Personalized 3D Generative Avatars from a Single Portrait Contributions: 1. Generate a personalized 3D avatar from a reference portrait image with controllable facial attributes. 2. Create high-quality synthetic 2D video datasets with diverse attribute editing from a reference portrait image. 3. Use latent space regularization with face morphing supervision for a continuous and smooth latent space, enhancing the generative ability for unseen or interpolated attribute appearances. 4. Employ an efficient fine-tuning technique via Low-Rank Adaptation (LoRA) [26] to integrate any new facial attribute into the avatar model.
0:45

Personalized 3D Generative Avatars from a Single Portrait Contributions: 1. Generate a personalized 3D avatar from a reference portrait image with controllable facial attributes. 2. Create high-quality synthetic 2D video datasets with diverse attribute editing from a reference portrait image. 3. Use latent space regularization with face morphing supervision for a continuous and smooth latent space, enhancing the generative ability for unseen or interpolated attribute appearances. 4. Employ an efficient fine-tuning technique via Low-Rank Adaptation (LoRA) [26] to integrate any new facial attribute into the avatar model.

MrNeRF

20,507 views • 1 year ago

Designers don’t think in prompts. They think in shots, lighting, framing, and space. Magnific's 3D Scenes uses Marble to turn a single image into a controllable 3D environment, giving creative teams control and consistency for campaign visuals. Read the case study ↓
0:32

Designers don’t think in prompts. They think in shots, lighting, framing, and space. Magnific's 3D Scenes uses Marble to turn a single image into a controllable 3D environment, giving creative teams control and consistency for campaign visuals. Read the case study ↓

World Labs

44,198 views • 3 months ago

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models
0:22

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models

AK

131,344 views • 2 years ago

#ICCV2025 🤩3D world generation is cool, but it is cooler to play with the worlds using 3D actions 👆💨, and see what happens! — Introducing *WonderPlay*: Now you can create dynamic 3D scenes that respond to your 3D actions from a single image! Web: 🧵1/7
0:46

#ICCV2025 🤩3D world generation is cool, but it is cooler to play with the worlds using 3D actions 👆💨, and see what happens! — Introducing *WonderPlay*: Now you can create dynamic 3D scenes that respond to your 3D actions from a single image! Web: 🧵1/7

Hong-Xing (Koven) Yu

57,914 views • 1 year ago

Can we apply diffusion directly on MLP weights? Yes!!! We show generalization to new 3D shapes and 4D mesh animations: "HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion" #ICCV2023! Project: Video:
0:20

Can we apply diffusion directly on MLP weights? Yes!!! We show generalization to new 3D shapes and 4D mesh animations: "HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion" #ICCV2023! Project: Video:

Matthias Niessner

86,046 views • 3 years ago

We will present Intrinsic Image Diffusion #CVP2024! Material estimation is ambiguous -> we handle it with a probabilistic diffusion model. We obtain sharp albedo, roughness, and metallic maps just from a single image. By Peter Kocsis with Vincent Sitzmann.
0:25

We will present Intrinsic Image Diffusion #CVP2024! Material estimation is ambiguous -> we handle it with a probabilistic diffusion model. We obtain sharp albedo, roughness, and metallic maps just from a single image. By Peter Kocsis with Vincent Sitzmann.

Matthias Niessner

16,073 views • 2 years ago

Accurate and controllable scene generation has been difficult with natural language alone. You instead need a language for scenes. Introducing the Scene Language — a visual representation for high-quality 3D/4D generation by integrating programs, words, and embeddings — 🧵(1/6)
0:31

Accurate and controllable scene generation has been difficult with natural language alone. You instead need a language for scenes. Introducing the Scene Language — a visual representation for high-quality 3D/4D generation by integrating programs, words, and embeddings — 🧵(1/6)

Yunzhi Zhang

63,956 views • 1 year ago

Image-Blaster is a Claude skill that can create an entire 3D environment from a single image. The special sauce here is that it also extracts key environment elements and converts them into their own separate 3D models. Full YT video:
0:53

Image-Blaster is a Claude skill that can create an entire 3D environment from a single image. The special sauce here is that it also extracts key environment elements and converts them into their own separate 3D models. Full YT video:

Matt Workman

25,206 views • 3 months ago

📢WorldMesh is accepted to #ECCV2026, and we're releasing the code today! 🎉 Led by mschneider456: navigable, multi-room 3D scenes from a text prompt, with a mesh scaffold conditioning image diffusion for global consistency + photorealistic detail 👇
0:36

📢WorldMesh is accepted to #ECCV2026, and we're releasing the code today! 🎉 Led by mschneider456: navigable, multi-room 3D scenes from a text prompt, with a mesh scaffold conditioning image diffusion for global consistency + photorealistic detail 👇

Angela Dai

42,111 views • 1 month ago

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)
0:20

⚡️ Introducing Bolt3D ⚡️ Bolt3D generates interactive 3D scenes in less than 7 seconds on a single GPU from one or more images. It features a latent diffusion model that *directly* generates 3D Gaussians of seen and unseen regions, without any test time optimization. 🧵👇 (1/9)

Stan Szymanowicz

126,030 views • 1 year ago