Video yükleniyor...

Video Yüklenemedi

Bu video yüklenirken bir sorun oluştu. Bu geçici bir ağ sorunundan kaynaklanıyor olabilir veya video kullanılamıyor olabilir.

Ana Sayfaya Dön

Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion Paper: (not yet) Project: Code:

MrNeRF

16,707 subscribers

19,907 görüntüleme • 2 yıl önce •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

1 Yorum

MrNeRF profil fotoğrafı

MrNeRF2 yıl önce

Paper arived:

Benzer Videolar

DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians from Video Diffusion Priors Code:

DreamPhysics: Learning Physical Properties of Dynamic 3D Gaussians from Video Diffusion Priors Code:

MrNeRF

12,360 görüntüleme • 2 yıl önce

FP4 Explore, BF16 Train Diffusion Reinforcement Learning via Efficient Rollout Scaling paper:

FP4 Explore, BF16 Train Diffusion Reinforcement Learning via Efficient Rollout Scaling paper:

AK

12,778 görüntüleme • 3 ay önce

🚀High-Res 3D Text-to-Texture🚀 🎨#MVPaint delivers high-res 3D textures with minimal UV wrapping dependency and high versatility using synchronized multi-view diffusion 📑 Paper: 🏠 Project Page: 🧑‍💻 Code:

🚀High-Res 3D Text-to-Texture🚀 🎨#MVPaint delivers high-res 3D textures with minimal UV wrapping dependency and high versatility using synchronized multi-view diffusion 📑 Paper: 🏠 Project Page: 🧑‍💻 Code:

Ziwei Liu

28,122 görüntüleme • 1 yıl önce

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,640 görüntüleme • 10 ay önce

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

Oh wow! "[SIGGRAPH '24] DreamMat: High-quality PBR Material Generation with Geometry- and Light-aware Diffusion Models" Paper: Project: Code (MIT) :

MrNeRF

59,766 görüntüleme • 2 yıl önce

🚀 Introducing #DreamCraft3D, our breakthrough hierarchical technique for 3D content generation. Leading the way in AIGC, we're redefining 3D generation: Project page: Paper: Code:

🚀 Introducing #DreamCraft3D, our breakthrough hierarchical technique for 3D content generation. Leading the way in AIGC, we're redefining 3D generation: Project page: Paper: Code:

DeepSeek

16,667 görüntüleme • 2 yıl önce

Feed-forward 3D Gaussians from Visual Geometry Group (VGG) strike again! Flash3D has now been accepted to 3DV 2025: it is a method for feed-forward single-view 3D scene reconstruction. Project page: Code: Arxiv: A 🧵👇

Feed-forward 3D Gaussians from Visual Geometry Group (VGG) strike again! Flash3D has now been accepted to 3DV 2025: it is a method for feed-forward single-view 3D scene reconstruction. Project page: Code: Arxiv: A 🧵👇

Stan Szymanowicz

26,970 görüntüleme • 1 yıl önce

Gaussians are becoming more versatile! It's a new generation of tools interactively bending reality! The paper is accepted at SIGGRAPH 2025 and the code is released!

Gaussians are becoming more versatile! It's a new generation of tools interactively bending reality! The paper is accepted at SIGGRAPH 2025 and the code is released!

MrNeRF

24,925 görüntüleme • 1 yıl önce

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:

📢Excited to be at #ICLR2025 for our paper: VD3D: Taming Large Video Diffusion Transformers for 3D Camera Control Poster: Thu 3-5:30 PM (#134) Website: Code: Also check out our #CVPR2025 follow-up AC3D:

Sherwin Bahmani

11,608 görüntüleme • 1 yıl önce

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,496 görüntüleme • 2 yıl önce

[SIGGRAPH '24] RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting Paper (pdf link): Project: Code: Method ⬇️ 1 I 2

[SIGGRAPH '24] RTG-SLAM: Real-time 3D Reconstruction at Scale Using Gaussian Splatting Paper (pdf link): Project: Code: Method ⬇️ 1 I 2

MrNeRF

35,675 görüntüleme • 2 yıl önce

Excited to share our recent work, UniSH, which unifies dynamic 3D scene reconstruction and SMPL estimation within a single framework. (Left-top is input video). Code has been released! Project page: Paper:

Excited to share our recent work, UniSH, which unifies dynamic 3D scene reconstruction and SMPL estimation within a single framework. (Left-top is input video). Code has been released! Project page: Paper:

Yuan Liu

19,258 görüntüleme • 6 ay önce

🍎Thinking with Video towards Law-Grounded Physical Intelligence🍎 🥧Apple-π🥧 is the first benchmark that asks video models to reason through explicit physical laws w/ an auditable test of physical intelligence - Project: - Code:

🍎Thinking with Video towards Law-Grounded Physical Intelligence🍎 🥧Apple-π🥧 is the first benchmark that asks video models to reason through explicit physical laws w/ an auditable test of physical intelligence - Project: - Code:

Ziwei Liu

22,590 görüntüleme • 7 gün önce

Can we apply diffusion directly on MLP weights? Yes!!! We show generalization to new 3D shapes and 4D mesh animations: "HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion" #ICCV2023! Project: Video:

Can we apply diffusion directly on MLP weights? Yes!!! We show generalization to new 3D shapes and 4D mesh animations: "HyperDiffusion: Generating Implicit Neural Fields with Weight-Space Diffusion" #ICCV2023! Project: Video:

Matthias Niessner

86,046 görüntüleme • 3 yıl önce

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency

V3D Video Diffusion Models are Effective 3D Generators Automatic 3D generation has recently attracted widespread attention. Recent methods have greatly accelerated the generation speed, but usually produce less-detailed objects due to limited model capacity or 3D data. Motivated by recent advancements in video diffusion models, we introduce V3D, which leverages the world simulation capacity of pre-trained video diffusion models to facilitate 3D generation. To fully unleash the potential of video diffusion to perceive the 3D world, we further introduce geometrical consistency prior and extend the video diffusion model to a multi-view consistent 3D generator. Benefiting from this, the state-of-the-art video diffusion model could be fine-tuned to generate 360degree orbit frames surrounding an object given a single image. With our tailored reconstruction pipelines, we can generate high-quality meshes or 3D Gaussians within 3 minutes. Furthermore, our method can be extended to scene-level novel view synthesis, achieving precise control over the camera path with sparse input views. Extensive experiments demonstrate the superior performance of the proposed approach, especially in terms of generation quality and multi-view consistency

AK

31,997 görüntüleme • 2 yıl önce

"I was thrilled with the opportunity to create visuals for ‘Panopticom’ and at the possibility of creating a music video for Peter Gabriel. I created this video in 1 week with the use of Stable Diffusion Deforum via the open-source WebUI, Automatic1111, after months of deep-dive learning and creating 2D and 3D motion parameters within the tool." - @_vnderworld Vnderworld's official video for Peter's 'Panopticom' will be out tomorrow! Stable Diffusion

"I was thrilled with the opportunity to create visuals for ‘Panopticom’ and at the possibility of creating a music video for Peter Gabriel. I created this video in 1 week with the use of Stable Diffusion Deforum via the open-source WebUI, Automatic1111, after months of deep-dive learning and creating 2D and 3D motion parameters within the tool." - @_vnderworld Vnderworld's official video for Peter's 'Panopticom' will be out tomorrow! Stable Diffusion

Peter Gabriel

115,128 görüntüleme • 2 yıl önce

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:

Matthias Niessner

74,905 görüntüleme • 3 yıl önce

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

🚀Turn Single Image into 3D Human🚀 #GeneMAN is a generalizable single-image 3D human reconstruction framework that turns in-the-wild images into high-quality 3D humans with ease 🔗Project: 📜Paper: 🧑‍💻Code:

Ziwei Liu

26,953 görüntüleme • 1 yıl önce

This is a single uncut video, showing a robot learning several tasks instantly, after just one demonstration each ... This is possible because we've now been able to achieve in-context learning for everyday robotics tasks, and I'm very excited to announce our latest paper: 🎆 Instant Policy: In-Context Imitation Learning via Graph Diffusion 🎆 (1/6) 🧵👇

This is a single uncut video, showing a robot learning several tasks instantly, after just one demonstration each ... This is possible because we've now been able to achieve in-context learning for everyday robotics tasks, and I'm very excited to announce our latest paper: 🎆 Instant Policy: In-Context Imitation Learning via Graph Diffusion 🎆 (1/6) 🧵👇

Edward Johns

74,683 görüntüleme • 1 yıl önce

🏃Motion Tokenizer Bridging Semantic and Kinematic Conditions🏃‍♀️ #MoTok is a diffusion-based tokenizer that unifies *perception-planning-control*, combining the strengths of continuous diffusion & discrete tokens - Project: - Code:

🏃Motion Tokenizer Bridging Semantic and Kinematic Conditions🏃‍♀️ #MoTok is a diffusion-based tokenizer that unifies perception-planning-control, combining the strengths of continuous diffusion & discrete tokens - Project: - Code:

Ziwei Liu

19,259 görüntüleme • 4 ay önce