正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Image to depth using Marigold and ConfyUI Then depth to 3D geometry in Blender Super interesting stuff 🤯

A.I.Warper

32,961 subscribers

201,906 次观看 • 2 年前 •via X (Twitter)

艺术教育科学技术

Anya Rossi• Live Now

Private livecam show

9 条评论

A.I.Warper 的头像

A.I.Warper2 年前

Image and video by @Kijaidesign . Big brain … go follow 😂

Anton Obukhov 的头像

Anton Obukhov2 年前

@KBingxin And now you can print it!

CoffeeVectors 的头像

CoffeeVectors2 年前

Yesssss

A.I.Warper 的头像

A.I.Warper2 年前

Need a golem? NP

OctaSpace Hub 🔶 的头像

OctaSpace Hub 🔶2 年前

Great work 👏

Ivan_Qtech 的头像

Ivan_Qtech2 年前

I am trying to build a name printing business, this could automate things a lot

Eprom Lee 的头像

Eprom Lee2 年前

wow!!!

Peter Brand2 年前

So basically, displacement maps.

DreamStarter 的头像

DreamStarter2 年前

Do we have any option for image to vector displacement?

相关视频

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

KIRI Engine - 3D Scanner App

26,777 次观看 • 6 个月前

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

Joseph Azar

14,041 次观看 • 5 个月前

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

CoffeeVectors

135,713 次观看 • 2 年前

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Cristian Peñas ░░░░░░░░

445,471 次观看 • 3 年前

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Sr Freak©

18,255 次观看 • 5 个月前

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

CG Boost

67,797 次观看 • 1 年前

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Joseph Azar

74,880 次观看 • 5 个月前

$.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:$

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:

80 LEVEL

34,685 次观看 • 6 个月前

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

Mickmumpitz

47,986 次观看 • 6 个月前

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

149,128 次观看 • 5 个月前

Sweet! Marigold V2 is in ComfyUI now. turns regular 2D images into ultra-detailed 3D depth maps. - individual hairs, animal fur, thin foliage - handles surface normals/material properties in a single step - super fast

Sweet! Marigold V2 is in ComfyUI now. turns regular 2D images into ultra-detailed 3D depth maps. - individual hairs, animal fur, thin foliage - handles surface normals/material properties in a single step - super fast

Wildminder

31,757 次观看 • 1 个月前

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,746 次观看 • 3 年前

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

Gradio

11,820 次观看 • 1 年前

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,305 次观看 • 2 年前

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,458 次观看 • 3 年前

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

Jettelly Inc.

30,911 次观看 • 5 个月前

Marigold V2: Repurposes a pretrained diffusion transformer into single-step dense predictors: depth, see-through depth, surface normals, albedo, and other dense modalities. Works in consumer GPU. Apache-2.0 license

Marigold V2: Repurposes a pretrained diffusion transformer into single-step dense predictors: depth, see-through depth, surface normals, albedo, and other dense modalities. Works in consumer GPU. Apache-2.0 license

Arun Kurian

40,493 次观看 • 1 个月前

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

CHRIS FIRST

107,394 次观看 • 11 个月前