Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Meta presents Garment3DGen! A method that can stylize the geometry and textures from 2D image and 3D mesh garments, which can be fitted on top of parametric bodies and be simulated 🔥 More examples ⬇️

Dreaming Tulpa 🥓👑

54,870 subscribers

157,965 views • 2 years ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

10 Comments

Dreaming Tulpa 🥓👑2 years ago

The method supports mesh deformations like turning a tank-top into a dress.

Dreaming Tulpa 🥓👑2 years ago

ControlNet enables turning rough 2D sketches into images which can then be turned into animatable 3D garments using Garment3DGen.

Dreaming Tulpa 🥓👑2 years ago

Bonus: Knight armor

Dreaming Tulpa 🥓👑2 years ago

The code isn't available yet, but luckily it's from Meta, so there is a chance this will drop soon! In the mean time, you can learn more about Garment3DGen here: For more Generative AI fun: ✨ Follow yours truly @dreamingtulpa ✨ Like and repost 👇

Tyrell Corporation Operations2 years ago

@in3d_nz Oh god, more men in dresses...

Dreaming Tulpa 🥓👑2 years ago

@in3d_nz 😂

Key2 years ago

@naaveelab Love the innovative approach with Garment3DGen, enhancing parametric bodies with stylized 2D image textures - truly pushing the boundaries of fashion technology!

Xiaoyu Xiang2 years ago

Thanks for sharing our work!

bitpixi 🧚🏻‍♂️2 years ago

@dankvr

alan2 years ago

期待(✧∀✧)

Related Videos

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Nvidia presents Edify 3D! The method can generate high-quality 3D assets from text descriptions. It uses a diffusion model to create detailed quad-mesh topologies and high-resolution textures in under 2 minutes.

Dreaming Tulpa 🥓👑

39,517 views • 1 year ago

This video looks at converting a Displacement texture into actual geometry, that can be 3D printed or sculpted on. Textures from Polyhaven. #Blender #B3D #Blender3d

This video looks at converting a Displacement texture into actual geometry, that can be 3D printed or sculpted on. Textures from Polyhaven. #Blender #B3D #Blender3d

Jan van den Hemel

10,549 views • 1 year ago

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,643 views • 3 years ago

Image & video synthesis struggle with the scale of truly large 3D scenes. mschneider456 presents a geometry-first approach : - structure first: mesh scaffold defining the scene - then appearance: mesh-conditioned image synthesis Check it out:

Image & video synthesis struggle with the scale of truly large 3D scenes. mschneider456 presents a geometry-first approach : - structure first: mesh scaffold defining the scene - then appearance: mesh-conditioned image synthesis Check it out:

Angela Dai

19,486 views • 3 months ago

Nature presents a captivating confluence of similarity and diversity. Our new method 3D-Fauna learns a pan-category articulated 3D model of quadruped animals from Internet photos. At test time, it turns a single image into an animatable textured 3D mesh in a feed-forward pass.

Nature presents a captivating confluence of similarity and diversity. Our new method 3D-Fauna learns a pan-category articulated 3D model of quadruped animals from Internet photos. At test time, it turns a single image into an animatable textured 3D mesh in a feed-forward pass.

Elliott / Shangzhe Wu

107,260 views • 2 years ago

AI can now generate high-quality textures for 3D objects! The method is called Material Anything and can generate realistic materials which are UV mapped. Small AI driven game studios are going to be the future. Code below 👇

AI can now generate high-quality textures for 3D objects! The method is called Material Anything and can generate realistic materials which are UV mapped. Small AI driven game studios are going to be the future. Code below 👇

Dreaming Tulpa 🥓👑

21,696 views • 1 year ago

David Lammy and Labour are passing a law which means that existing graves can be exhumed and the bodies cremated so that they can be re-used by others. So who benefits from this - the religion that insists on burials and no cremations?🤔🤔🤔

David Lammy and Labour are passing a law which means that existing graves can be exhumed and the bodies cremated so that they can be re-used by others. So who benefits from this - the religion that insists on burials and no cremations?🤔🤔🤔

Dave

242,803 views • 2 months ago

You can build your 3D models directly from a prompt into Claude code. All thanks to this beautiful python project, build123 a parametric modeling framework for 2D and 3D CAD. It is built on the Open Cascade geometric kernel and it is suitable for 3D printing.

You can build your 3D models directly from a prompt into Claude code. All thanks to this beautiful python project, build123 a parametric modeling framework for 2D and 3D CAD. It is built on the Open Cascade geometric kernel and it is suitable for 3D printing.

Marco Franzon

20,777 views • 2 months ago

3D modeling tools dictate how many objects look — but what about how they feel? MIT's "TactStyle" program enables creators to use image prompts to stylize the textures of 3D models. It can customize the tactile properties of accessories, decor, & more:

3D modeling tools dictate how many objects look — but what about how they feel? MIT's "TactStyle" program enables creators to use image prompts to stylize the textures of 3D models. It can customize the tactile properties of accessories, decor, & more:

MIT CSAIL

57,878 views • 1 year ago

AI can synthesize dynamic textures on 3D meshes without UV maps! MeshNCA is a model that can generate dynamic textures from images, text prompts, and motion vector fields.

AI can synthesize dynamic textures on 3D meshes without UV maps! MeshNCA is a model that can generate dynamic textures from images, text prompts, and motion vector fields.

Dreaming Tulpa 🥓👑

79,593 views • 2 years ago

By popular demand, we're sharing more examples that showcase CSM Cube's ability to generate high-quality 3D mesh topology and distinct parts. The results shown were achieved using our single-click Image-to-3D feature, but users can obtain even better quality with careful prompting and editing.

By popular demand, we're sharing more examples that showcase CSM Cube's ability to generate high-quality 3D mesh topology and distinct parts. The results shown were achieved using our single-click Image-to-3D feature, but users can obtain even better quality with careful prompting and editing.

Common Sense Machines

16,882 views • 10 months ago

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

AI can now create interactive 3D worlds from just image and text prompts… Literally be the penguin

Min Choi

62,250 views • 4 months ago

If anyone is needing any vtube work done this week let me know! I can basically take any 3D or 2d image and rig it up to be used for videos and streaming Finally got caught up on the last few. Here’s some examples of what they look like.

If anyone is needing any vtube work done this week let me know! I can basically take any 3D or 2d image and rig it up to be used for videos and streaming Finally got caught up on the last few. Here’s some examples of what they look like.

🔥burningbush.eth🔥

19,219 views • 2 years ago

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Adobe is entering the image-to-3D game! Their new method, LRM, can create high-fidelity 3D meshes from a single image in just 5 seconds 🔥 It's trained on 1 million objects and is able to generate objects from real-world images and generative AI models.

Dreaming Tulpa 🥓👑

270,942 views • 2 years ago

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Nvidia presents EdgeRunner! The method can generate high-quality 3D meshes with up to 4,000 faces at a spatial resolution of 512 from images and point-clouds.

Dreaming Tulpa 🥓👑

173,103 views • 1 year ago

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

3D Gaussian Splats are cool, but they're static (Part 25). DG-Mesh can reconstruct high-quality and time-consistent 3D meshes from a single video and track mesh vertices over time, which enables texture editing on dynamic objects.

Dreaming Tulpa 🥓👑

79,033 views • 2 years ago

Technicians spent more than a week scanning and stabilizing “Gugusse and the Automaton" – which features, by the way, the first known moving image of what might be called a robot – so that it can now be enjoyed by anyone online!

Technicians spent more than a week scanning and stabilizing “Gugusse and the Automaton" – which features, by the way, the first known moving image of what might be called a robot – so that it can now be enjoyed by anyone online!

Library of Congress

25,826 views • 4 months ago

📢 SHeaP: Self-Supervised Head Predictor Learned via 2D Gaussians 📢 Given a single input image, we predict accurate 3D head geometry, pose, and expression. Previous works (e.g. DECA, EMOCA) use differentiable mesh rasterization to learn a self-supervised head geometry predictor via a photometric reconstruction loss. We borrow these ideas, but our key insight is to replace the mesh rendering with 2D Gaussian Splatting. This leads to much higher accuracy of the underlying predicted geometry and thus more gradient signal during training. 🌍 🎥 Great work by Liam Schoneveld Davide Davoli Jiapeng Tang

📢 SHeaP: Self-Supervised Head Predictor Learned via 2D Gaussians 📢 Given a single input image, we predict accurate 3D head geometry, pose, and expression. Previous works (e.g. DECA, EMOCA) use differentiable mesh rasterization to learn a self-supervised head geometry predictor via a photometric reconstruction loss. We borrow these ideas, but our key insight is to replace the mesh rendering with 2D Gaussian Splatting. This leads to much higher accuracy of the underlying predicted geometry and thus more gradient signal during training. 🌍 🎥 Great work by Liam Schoneveld Davide Davoli Jiapeng Tang

Matthias Niessner

28,559 views • 1 year ago

Adobe presents SynCHMR! A method that can reconstruct camera trajectory, human motion, and scene in one global coordinate from videos 🔥

Adobe presents SynCHMR! A method that can reconstruct camera trajectory, human motion, and scene in one global coordinate from videos 🔥

Dreaming Tulpa 🥓👑

108,628 views • 2 years ago

Gen-3 Alpha can generate detailed and complex simulations, fluids, textures and shapes. Including 2D and 3D text. To learn how, read the prompt guide here:

Gen-3 Alpha can generate detailed and complex simulations, fluids, textures and shapes. Including 2D and 3D text. To learn how, read the prompt guide here:

Runway

68,054 views • 2 years ago