正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion abs: project page:

AK

442,107 subscribers

262,780 次观看 • 3 年前 •via X (Twitter)

游戏科学技术教育

Anya Rossi• Live Now

Private livecam show

9 条评论

Alex Leiva 的头像

Alex Leiva3 年前

Cool! But those dead eyes... 😅

Crystalwizard 的头像

Crystalwizard3 年前

the blender crowd is going to go crazy

UneditedMarble 的头像

UneditedMarble3 年前

When available?

Tengfei Wang 的头像

Tengfei Wang3 年前

Our demo video is at

Bobcat 的头像

Bobcat3 年前

Sweet, I was just looking again at your previous post about it / their previous webpage like two hours ago.

vivid0036 的头像

vivid00363 年前

Will it be able to generate the avatar from a photo of someone with a mask or with a surprising face? ~^ ^

Chenyang Lei 的头像

Chenyang Lei3 年前

awesome project!

LesPatriotes du Nord (59) 的头像

LesPatriotes du Nord (59)3 年前

😬😳 #avatar, not the fiction.

Cien λ 的头像

Cien λ3 年前

I want to try this asap

相关视频

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

AK

304,708 次观看 • 3 年前

Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model abs: project page:

Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model abs: project page:

AK

90,072 次观看 • 3 年前

Towards Realistic Generative 3D Face Models abs: project page:

Towards Realistic Generative 3D Face Models abs: project page:

AK

48,089 次观看 • 3 年前

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

AK

163,868 次观看 • 3 年前

Single Motion Diffusion abs: project page:

Single Motion Diffusion abs: project page:

AK

72,767 次观看 • 3 年前

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

📢 Lyra: Generative 3D Scene Reconstruction via Video Diffusion Model Self-Distillation Got only one or a few images and wondering if recovering the 3D environment is a reconstruction or generation problem? Why not do it with a generative reconstruction model! We show that a camera-conditioned video diffusion model can be transformed into a generative reconstruction model that directly outputs a high-quality 3D Gaussian Splatting representation through self-distillation, without requiring real-world training data. Check out our results in the video (wait for dynamic scenes in the second half!) : Project Page: Code and Models: Paper:

Sherwin Bahmani

66,327 次观看 • 8 个月前

PERSE Personalized 3D Generative Avatars from A Single Portrait

PERSE Personalized 3D Generative Avatars from A Single Portrait

AK

45,885 次观看 • 1 年前

#SIGGRAPH2024 🏆Best Paper Honorable Mentioned Introducing the magic behind #Rodin ( CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets (1/n) CLAY is 3D #stablediffusion + #ControlNet + #LoRA.

#SIGGRAPH2024 🏆Best Paper Honorable Mentioned Introducing the magic behind #Rodin ( CLAY: A Controllable Large-scale Generative Model for Creating High-quality 3D Assets (1/n) CLAY is 3D #stablediffusion + #ControlNet + #LoRA.

Deemos

30,855 次观看 • 1 年前

3D-aware Conditional Image Synthesis abs: project page:

3D-aware Conditional Image Synthesis abs: project page:

AK

301,415 次观看 • 3 年前

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

AK

317,619 次观看 • 3 年前

🚀High-Res 3D Text-to-Texture🚀 🎨#MVPaint delivers high-res 3D textures with minimal UV wrapping dependency and high versatility using synchronized multi-view diffusion 📑 Paper: 🏠 Project Page: 🧑‍💻 Code:

🚀High-Res 3D Text-to-Texture🚀 🎨#MVPaint delivers high-res 3D textures with minimal UV wrapping dependency and high versatility using synchronized multi-view diffusion 📑 Paper: 🏠 Project Page: 🧑‍💻 Code:

Ziwei Liu

28,122 次观看 • 1 年前

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

Phidias A Generative Model for Creating 3D Content from Text, Image, and 3D Conditions with Reference-Augmented Diffusion discuss: In 3D modeling, designers often use an existing 3D model as a reference to create new ones. This practice has inspired the development of Phidias, a novel generative model that uses diffusion for reference-augmented 3D generation. Given an image, our method leverages a retrieved or user-provided 3D reference model to guide the generation process, thereby enhancing the generation quality, generalization ability, and controllability. Our model integrates three key components: 1) meta-ControlNet that dynamically modulates the conditioning strength, 2) dynamic reference routing that mitigates misalignment between the input image and 3D reference, and 3) self-reference augmentations that enable self-supervised training with a progressive curriculum. Collectively, these designs result in a clear improvement over existing methods. Phidias establishes a unified framework for 3D generation using text, image, and 3D conditions with versatile applications.

AK

25,120 次观看 • 1 年前

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 次观看 • 1 年前

Dreamix: Video Diffusion Models are General Video Editors abs: project page: present diffusion-based method that is able to perform text-based motion and appearance editing of general videos

Dreamix: Video Diffusion Models are General Video Editors abs: project page: present diffusion-based method that is able to perform text-based motion and appearance editing of general videos

AK

398,132 次观看 • 3 年前

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

Align your Latents: High-Resolution Video Synthesis with Latent Diffusion Models turn the publicly available, state-of-the-art text-to-image LDM Stable Diffusion into an efficient and expressive text-to-video model with resolution up to 1280 x 2048 abs: project page:

AK

718,682 次观看 • 3 年前

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,442 次观看 • 2 年前

Word-As-Image for Semantic Typography abs: project page:

Word-As-Image for Semantic Typography abs: project page:

AK

385,996 次观看 • 3 年前

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing *which* part of your model you should mess with Internship by Sherwin Bahmani at Snap

📢📢📢 𝐀𝐂𝟑𝐃: Analyzing and Improving 3D Camera Control in Video Diffusion Transformers TL;DR: for 3D camera control in generative video, it really helps knowing which part of your model you should mess with Internship by Sherwin Bahmani at Snap

Andrea Tagliasacchi 🇨🇦→✈️→🇺🇲 (@CVPR)

23,040 次观看 • 1 年前

Vision-Language Foundation model should go to 3D for robotics!🤖 CoRL23 Oral: GNFactor learns Generalizable Neural Feature Fields for language conditioned manipulation on diverse scenes. It unifies 3D➕Stable Diffusion features using generalizable NeRFs.

Vision-Language Foundation model should go to 3D for robotics!🤖 CoRL23 Oral: GNFactor learns Generalizable Neural Feature Fields for language conditioned manipulation on diverse scenes. It unifies 3D➕Stable Diffusion features using generalizable NeRFs.

Xiaolong Wang

56,268 次观看 • 2 年前

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.

A new frontier. Project Starlight—the first and only diffusion-based AI model for enhancing video. Launching soon.

Topaz Labs

22,375 次观看 • 1 年前