Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

DreamBooth3D: Subject-Driven Text-to-3D Generation Personalized 3D models from just a few casual photos, with text-driven modifications abs: project page:

AK

504,651 subscribers

107,503 views • 3 years ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

12 Comments

AnonymousDestiny3 years ago

I really hope they or someone puts up an implementation for this. 🙏

Moescape AI1 year ago

Sign up & create wholesome anime art on Moescape AI now!

JPEG3 years ago

Character Turnarounds SD + ControlNet + Dreambooth 3D = 🥳🥳🥳

vacuum3 years ago

Will they release source code? No Will they do something with it? No Great work, but NeRF is the future. Google as always choking itself. 😑

Lawrence Valenza3 years ago

@yuliangxiu This is really what I’ve been waiting for, it always seemed obvious that you should be able to extract the mesh from dreambooth. I any ideas on when the demo should be available?

juand4bot3 years ago

so Nice, I want to test it and I'm terrifying Cause I feel that humanity at some point is not going to be able to follow the advance of the AI advances, ☠️👽

UnstableConcentration3 years ago

RIP 3d artists.

nDo3 years ago

@Scobleizer @SaveToNotion #thread

Gonza Othacehe3 years ago

Could I generate models for Three.js?

Jouvier3 years ago

@SaveToNotion #thread #ia

wwwwg3 years ago

@Memdotai mem it

AK1 year ago

Vibe coding a AI search app DeepSearch, made with a few prompts and deployed on Hugging Face

Related Videos

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses

SceneScape: Text-Driven Consistent Scene Generation abs: project page: text-driven perpetual view generation -- synthesizing long videos of arbitrary scenes solely from an input text describing the scene and camera poses

AK

73,258 views • 3 years ago

Expressive Text-to-Image Generation with Rich Text abs: project page:

Expressive Text-to-Image Generation with Rich Text abs: project page:

AK

209,253 views • 3 years ago

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

Google announces InseRF Text-Driven Generative Object Insertion in Neural 3D Scenes paper page: InseRF generates an object in a 3D scene via a text prompt and one 2D bounding box

AK

205,987 views • 2 years ago

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

SceneDreamer: Unbounded 3D Scene Generation from 2D Image Collections abs: project page:

AK

317,619 views • 3 years ago

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

Generative Novel View Synthesis with 3D-Aware Diffusion Models abs: project page:

AK

304,708 views • 3 years ago

Towards Realistic Generative 3D Face Models abs: project page:

Towards Realistic Generative 3D Face Models abs: project page:

AK

48,089 views • 3 years ago

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

Make-It-3D: High-Fidelity 3D Creation from A Single Image with Diffusion Prior abs: project page:

AK

163,868 views • 3 years ago

MusicLM: Generating Music From Text abs: project page:

MusicLM: Generating Music From Text abs: project page:

AK

434,169 views • 3 years ago

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

MVDream: Multi-view Diffusion for 3D Generation paper page: propose MVDream, a multi-view diffusion model that is able to generate geometrically consistent multi-view images from a given text prompt. By leveraging image diffusion models pre-trained on large-scale web datasets and a multi-view dataset rendered from 3D assets, the resulting multi-view diffusion model can achieve both the generalizability of 2D diffusion and the consistency of 3D data. Such a model can thus be applied as a multi-view prior for 3D generation via Score Distillation Sampling, where it greatly improves the stability of existing 2D-lifting methods by solving the 3D consistency problem. Finally, we show that the multi-view diffusion model can also be fine-tuned under a few shot setting for personalized 3D generation, i.e. DreamBooth3D application, where the consistency can be maintained after learning the subject identity.

AK

294,442 views • 2 years ago

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:

(1/4) Excited to share our #ICCV2023 paper Text2Room! We generate scene-scale textured 3D meshes from a given text prompt leveraging 2D text-to-image models such as StableDiffusion. Project: Code: Video:

Matthias Niessner

74,895 views • 2 years ago

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models

Nvidia just announced Align Your Gaussians Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models

AK

131,322 views • 2 years ago

Designing an Encoder for Fast Personalization of Text-to-Image Models TL;DR: use an encoder to personalize a text-to-image model to new concepts with a single image and 5-15 tuning steps abs: project page:

Designing an Encoder for Fast Personalization of Text-to-Image Models TL;DR: use an encoder to personalize a text-to-image model to new concepts with a single image and 5-15 tuning steps abs: project page:

AK

165,158 views • 3 years ago

To generate 3D models in Codex with text-to-cad: Start a new project, write your prompt for a 3D model, and include a link to clone the text-to-cad repo. Codex handles the rest. The repo is open source and all scripts / ui run locally. Link below.

To generate 3D models in Codex with text-to-cad: Start a new project, write your prompt for a 3D model, and include a link to clone the text-to-cad repo. Codex handles the rest. The repo is open source and all scripts / ui run locally. Link below.

Jake Fitzgerald

22,113 views • 2 months ago

CineMaster A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation

CineMaster A 3D-Aware and Controllable Framework for Cinematic Text-to-Video Generation

AK

18,655 views • 1 year ago

Creativity unleashed 👨‍🎨🎨✨ 👀 Edify3D from #NVIDIAResearch explores a new way to generate text-to-#3D images. 📗 Project page: 📝 Paper: 🔊 sound on

Creativity unleashed 👨‍🎨🎨✨ 👀 Edify3D from #NVIDIAResearch explores a new way to generate text-to-#3D images. 📗 Project page: 📝 Paper: 🔊 sound on

NVIDIA AI Developer

177,497 views • 1 year ago

Introducing AI 3D Generation ✨ 🔥 Text to 3D 🖼️ Image to 3D 🌳 Remix 📐 Editor integration & Exports Available now!

Introducing AI 3D Generation ✨ 🔥 Text to 3D 🖼️ Image to 3D 🌳 Remix 📐 Editor integration & Exports Available now!

Spline

705,649 views • 2 years ago

3D AI is leveling up! Rodin 3D AI can create stunning, high-quality 3D models from just text or image inputs. And with its latest update, it can even generate 8K HDRI textures to bring your models to life. Check out the link in the comments!

3D AI is leveling up! Rodin 3D AI can create stunning, high-quality 3D models from just text or image inputs. And with its latest update, it can even generate 8K HDRI textures to bring your models to life. Check out the link in the comments!

el.cine

46,032 views • 1 year ago

BlendFields: Few-Shot Example-Driven Facial Modeling abs: paper page:

BlendFields: Few-Shot Example-Driven Facial Modeling abs: paper page:

AK

50,038 views • 3 years ago

📢 Matrix-3D: Omnidirectional 3D World Generation Ever wanted to turn a single image or a text prompt into a massive, explorable 3D world? That’s exactly what Matrix-3D does.

📢 Matrix-3D: Omnidirectional 3D World Generation Ever wanted to turn a single image or a text prompt into a massive, explorable 3D world? That’s exactly what Matrix-3D does.

Skywork

30,372 views • 10 months ago

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

DiffSplat Repurposing Image Diffusion Models for Scalable Gaussian Splat Generation DiffSplat is a generative framework to synthesize 3D Gaussian Splats from text prompts & single-view images in ⚡️ 1~2 seconds. It is fine-tuned directly from a pretrained text-to-image diffusion model.

AK

38,416 views • 1 year ago