Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Image to depth using Marigold and ConfyUI Then depth to 3D geometry in Blender Super interesting stuff 🤯

A.I.Warper

32,961 subscribers

201,906 views • 2 years ago •via X (Twitter)

Arts Education Science & Technology

Anya Rossi• Live Now

Private livecam show

9 Comments

A.I.Warper2 years ago

Image and video by @Kijaidesign . Big brain … go follow 😂

Anton Obukhov2 years ago

@KBingxin And now you can print it!

CoffeeVectors2 years ago

Yesssss

A.I.Warper2 years ago

Need a golem? NP

OctaSpace Hub 🔶2 years ago

Great work 👏

Ivan_Qtech2 years ago

I am trying to build a name printing business, this could automate things a lot

Eprom Lee2 years ago

wow!!!

Peter Brand2 years ago

So basically, displacement maps.

DreamStarter2 years ago

Do we have any option for image to vector displacement?

Related Videos

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

Joseph Azar

14,041 views • 2 months ago

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

CoffeeVectors

135,672 views • 2 years ago

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Cristian Peñas ░░░░░░░░

445,354 views • 2 years ago

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Sr Freak©

18,255 views • 2 months ago

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

CG Boost

66,810 views • 1 year ago

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma (Code and 3D implementation) - Three.js

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma (Code and 3D implementation) - Three.js

Joseph Azar

74,370 views • 1 month ago

$.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:$

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:

80 LEVEL

34,557 views • 2 months ago

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

147,333 views • 2 months ago

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

Mickmumpitz

47,295 views • 3 months ago

Custom Depth of Field with custom shapes using Ray Portal node, Blender 4.2. #blender #shaders #b3d #nodes

Custom Depth of Field with custom shapes using Ray Portal node, Blender 4.2. #blender #shaders #b3d #nodes

Shahzod Boyhonov

50,146 views • 2 years ago

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

Gradio

11,820 views • 1 year ago

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,643 views • 3 years ago

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,290 views • 2 years ago

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,439 views • 3 years ago

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

Jettelly Inc.

30,911 views • 2 months ago

Bad apple in spreadsheet in Blender using geometry nodes. #blender #b3d #geometrynodes

Bad apple in spreadsheet in Blender using geometry nodes. #blender #b3d #geometrynodes

Shahzod Boyhonov 🔶️

14,448 views • 1 year ago

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D

Jan van den Hemel

75,105 views • 3 years ago

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 views • 1 year ago

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

CHRIS FIRST

107,325 views • 8 months ago