Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Image to depth using Marigold and ConfyUI Then depth to 3D geometry in Blender Super interesting stuff 🤯

A.I.Warper

32,961 subscribers

201,906 Aufrufe • vor 2 Jahren •via X (Twitter)

Kunst Bildung Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von A.I.Warper

A.I.Warpervor 2 Jahren

Image and video by @Kijaidesign . Big brain … go follow 😂

Profilbild von Anton Obukhov

Anton Obukhovvor 2 Jahren

@KBingxin And now you can print it!

Profilbild von CoffeeVectors

CoffeeVectorsvor 2 Jahren

Yesssss

Profilbild von A.I.Warper

A.I.Warpervor 2 Jahren

Need a golem? NP

Profilbild von OctaSpace Hub 🔶

OctaSpace Hub 🔶vor 2 Jahren

Great work 👏

Profilbild von Ivan_Qtech

Ivan_Qtechvor 2 Jahren

I am trying to build a name printing business, this could automate things a lot

Profilbild von Eprom Lee

Eprom Leevor 2 Jahren

wow!!!

Peter Brandvor 2 Jahren

So basically, displacement maps.

Profilbild von DreamStarter

DreamStartervor 2 Jahren

Do we have any option for image to vector displacement?

Ähnliche Videos

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

KIRI Engine - 3D Scanner App

26,777 Aufrufe • vor 4 Monaten

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

Joseph Azar

14,041 Aufrufe • vor 3 Monaten

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

CoffeeVectors

135,713 Aufrufe • vor 2 Jahren

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Cristian Peñas ░░░░░░░░

445,374 Aufrufe • vor 3 Jahren

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Sr Freak©

18,255 Aufrufe • vor 3 Monaten

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

CG Boost

67,675 Aufrufe • vor 1 Jahr

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Joseph Azar

74,695 Aufrufe • vor 3 Monaten

$.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:$

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:

80 LEVEL

34,685 Aufrufe • vor 4 Monaten

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

148,148 Aufrufe • vor 3 Monaten

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

Mickmumpitz

47,295 Aufrufe • vor 4 Monaten

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,663 Aufrufe • vor 3 Jahren

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

Gradio

11,820 Aufrufe • vor 1 Jahr

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,305 Aufrufe • vor 2 Jahren

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,439 Aufrufe • vor 3 Jahren

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

Jettelly Inc.

30,911 Aufrufe • vor 3 Monaten

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D

Jan van den Hemel

75,105 Aufrufe • vor 3 Jahren

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 Aufrufe • vor 1 Jahr

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

CHRIS FIRST

107,394 Aufrufe • vor 9 Monaten

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇

Nikhil Keetha

123,025 Aufrufe • vor 11 Monaten