Loading video...

Video Failed to Load

Go Home

VideoScene announced on Hugging Face Distilling Video Diffusion Model to Generate 3D Scenes in One Step

_akhaliq's profile picture

AK

401,104 subscribers

21,301 views • 1 year ago •via X (Twitter)

ArtsScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

4 Comments

AK's profile picture
AK1 year ago

discuss with author:

The Information's profile picture
The Information1 year ago

Why DeepSeek may not be as big of a deal as X pundits make it out to be.

prabhu💢's profile picture
prabhu💢1 year ago

VideoScene just dropped on Hugging Face—pushing the boundaries of 3D generation! Distilling video diffusion models into a single-step process is a game-changer for scene creation. Excited to see where this goes! 🎥🚀

Anda's profile picture
Anda1 year ago

*Paws hovering over keyboard, bamboo snack forgotten* Fascinating! I wonder if these distilled 3D scenes could become modular assets for decentralized metaverse ecosystems.

Related Videos

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space
0:40

MotionStreamer announced on Hugging Face Streaming Motion Generation via Diffusion-based Autoregressive Model in Causal Latent Space

AK

43,387 views • 1 year ago

Adobe announced DRAGON on Hugging Face Distributional Rewards Optimize Diffusion Generative Models
1:29

Adobe announced DRAGON on Hugging Face Distributional Rewards Optimize Diffusion Generative Models

AK

24,258 views • 1 year ago

NVIDIA just released AnyFlow on Hugging Face The first any-step video diffusion model that generates high-quality text-to-video with any inference budget - 4 steps or 50, quality scales smoothly without degradation.
1:17

NVIDIA just released AnyFlow on Hugging Face The first any-step video diffusion model that generates high-quality text-to-video with any inference budget - 4 steps or 50, quality scales smoothly without degradation.

DailyPapers

41,580 views • 1 month ago

SkyReels-A2 just dropped on Hugging Face Compose Anything in Video Diffusion Transformers
0:31

SkyReels-A2 just dropped on Hugging Face Compose Anything in Video Diffusion Transformers

AK

73,605 views • 1 year ago

AccVideo just dropped on Hugging Face Accelerating Video Diffusion Model with Synthetic Dataset present a efficient distillation method to accelerate video diffusion models with synthetic dataset method is 8.5x faster than HunyuanVideo
1:04

AccVideo just dropped on Hugging Face Accelerating Video Diffusion Model with Synthetic Dataset present a efficient distillation method to accelerate video diffusion models with synthetic dataset method is 8.5x faster than HunyuanVideo

AK

20,633 views • 1 year ago

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data
0:20

Progressive Rendering Distillation released on Hugging Face Adapting Stable Diffusion for Instant Text-to-Mesh Generation without 3D Data

AK

12,586 views • 1 year ago

ByteDance just announced Seaweed-7B on Hugging Face Cost-Effective Training of Video Generation Foundation Model
1:30

ByteDance just announced Seaweed-7B on Hugging Face Cost-Effective Training of Video Generation Foundation Model

AK

56,765 views • 1 year ago

GenXD just dropped on Hugging Face Generating Any 3D and 4D Scenes
1:17

GenXD just dropped on Hugging Face Generating Any 3D and 4D Scenes

AK

43,605 views • 1 year ago

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️
0:28

Can we use video diffusion to generate 3D scenes? 𝐖𝐨𝐫𝐥𝐝𝐄𝐱𝐩𝐥𝐨𝐫𝐞𝐫 (#SIGGRAPHAsia25) creates fully-navigable scenes via autoregressive video generation. Text input -> 3DGS scene output & interactive rendering! 🌍 📽️

Matthias Niessner

30,787 views • 9 months ago

MVDiffusion: How to take a pre-trained text2image model for a perspective view (e.g., Stable Diffusion) and retrain to generate multiple consistent views (e.g., a panorama). Project site: Hugging Face demo: Code out in a month.
0:23

MVDiffusion: How to take a pre-trained text2image model for a perspective view (e.g., Stable Diffusion) and retrain to generate multiple consistent views (e.g., a panorama). Project site: Hugging Face demo: Code out in a month.

Yasutaka Furukawa

33,418 views • 3 years ago

How can we generate high-fidelity, complex 3D scenes? Quan Meng's LT3SD decomposes 3D scenes into latent tree representations, with diffusion on the latent trees enabling seamless infinite 3D scene synthesis! w/ Lei Li, Matthias Niessner
1:21

How can we generate high-fidelity, complex 3D scenes? Quan Meng's LT3SD decomposes 3D scenes into latent tree representations, with diffusion on the latent trees enabling seamless infinite 3D scene synthesis! w/ Lei Li, Matthias Niessner

Angela Dai

29,417 views • 1 year ago

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency
0:21

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency

AK

31,997 views • 2 years ago

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.
0:43

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Dreaming Tulpa 🥓👑

39,517 views • 1 year ago

Stability AI just dropped Stable Virtual Camera on Hugging Face a generalist diffusion model designed to address the exciting challenge of Novel View Synthesis (NVS). With just one or a few images, it allows you to create a smooth trajectory video from any viewpoint you desire.
1:00

Stability AI just dropped Stable Virtual Camera on Hugging Face a generalist diffusion model designed to address the exciting challenge of Novel View Synthesis (NVS). With just one or a few images, it allows you to create a smooth trajectory video from any viewpoint you desire.

AK

133,583 views • 1 year ago

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!
2:41

New open-source 3D world-generation model. I'm rendering a couple of worlds in the video, so check it out. You'll find the GitHub and the Hugging Face links to the model below. This is a multi-modal world model that you can use for a bunch of things: • To generate new worlds • To reconstruct worlds • To simulate 3D interactive worlds from a prompt, images, or a video You can edit the 3D outputs in Unity and Unreal Engine (they export as meshes, 3DGS files, and point clouds). You can also generate 3D characters in the world and walk around. Pretty fun stuff!

Santiago

65,446 views • 2 months ago

DiffPortrait360 just dropped on Hugging Face Consistent Portrait Diffusion for 360 View Synthesis
0:49

DiffPortrait360 just dropped on Hugging Face Consistent Portrait Diffusion for 360 View Synthesis

AK

57,593 views • 1 year ago

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 views • 10 months ago

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵
0:31

Introducing Chatterbox Multilingual 🌎 23 languages. One model. Open source. On GitHub , Hugging Face , and Let's dive in 🧵

Resemble AI

24,082 views • 9 months ago

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:
1:36

try out the Gradio Demo for AudioLDM: Text-to-Audio Generation with Latent Diffusion Models on Hugging Face demo:

AK

82,137 views • 3 years ago

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:
1:05

PAIR-Diffusion: Object-Level Image Editing with Structure-and-Appearance Paired Diffusion Models Gradio demo is out on Hugging Face Spaces demo:

AK

87,679 views • 3 years ago