Загрузка видео...

Не удалось загрузить видео

На главную

Image to depth using Marigold and ConfyUI Then depth to 3D geometry in Blender Super interesting stuff 🤯

AIWarper's profile picture

A.I.Warper

32,961 subscribers

201,906 просмотров • 2 лет назад •via X (Twitter)

ИскусствоОбразованиеНаука и технологии
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 9

Фото профиля A.I.Warper
A.I.Warper2 лет назад

Image and video by @Kijaidesign . Big brain … go follow 😂

Фото профиля Anton Obukhov
Anton Obukhov2 лет назад

@KBingxin And now you can print it!

Фото профиля CoffeeVectors
CoffeeVectors2 лет назад

Yesssss

Фото профиля A.I.Warper
A.I.Warper2 лет назад

Need a golem? NP

Фото профиля OctaSpace Hub 🔶
OctaSpace Hub 🔶2 лет назад

Great work 👏

Фото профиля Ivan_Qtech
Ivan_Qtech2 лет назад

I am trying to build a name printing business, this could automate things a lot

Фото профиля Eprom Lee
Eprom Lee2 лет назад

wow!!!

Фото профиля Peter Brand
Peter Brand2 лет назад

So basically, displacement maps.

Фото профиля DreamStarter
DreamStarter2 лет назад

Do we have any option for image to vector displacement?

Похожие видео

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.
0:25

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

KIRI Engine - 3D Scanner App

26,777 просмотров • 4 месяцев назад

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.
0:40

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to the geometry No manual code. Pure AI prompting. The future of 3D on the web feels wide open.

Joseph Azar

14,041 просмотров • 3 месяцев назад

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12
0:55

Made this video (🎶) with a Midjourney v6 image! Started by upscaling/refining with Magnific.ai, pulled a Marigold Depth Map from that in ComfyUI, then used as a displacement map in Blender where I animated this camera pass with some relighting and narrow depth of field.🧵1/12

CoffeeVectors

135,713 просмотров • 2 лет назад

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!
0:31

Midjourney-to-3D is now available! (Indeed, you can convert any 2D image to 3D) Please note that, for now, you'll need to manually set a depth map for your image in order to view its correct 3D version. (You can use to generate the depth map) But... stay tuned! We'll soon be offering instant 3D conversion for any image. *This is just an experimental version, and any feedback or videos of your results would be really interesting to see!

Cristian Peñas ░░░░░░░░

445,374 просмотров • 3 лет назад

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯
0:20

Blender Noob vs Pro artist - Convert Image To 3D Shapes 🤯

Sr Freak©

18,255 просмотров • 4 месяцев назад

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature
0:59

Jim Morren shares a Blender tip on creating Depth Maps to enhance the Subsurface Scattering effect of your 3D characters. Master 3D Characters in Blender Course: #b3d #blender3d #3dsculpting #3dcharacter #3d #3dart #3dtexturing #3dcreature

CG Boost

67,675 просмотров • 1 год назад

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js
0:42

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Joseph Azar

74,695 просмотров • 3 месяцев назад

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:
0:20

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:

80 LEVEL

34,685 просмотров • 4 месяцев назад

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl
0:40

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

148,148 просмотров • 3 месяцев назад

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.
0:39

I love open source AI in ComfyUI because it lets me control every step. For this spaceship shot I tracked the camera, designed layout geometry in Blender, exported depth maps, prompted the final look with an AI image editor, and jumped into Photoshop to clean it all up.

Mickmumpitz

47,295 просмотров • 4 месяцев назад

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇
0:33

🤯 OneDiffusion: A versatile, large-scale diffusion model that seamlessly supports bidirectional image synthesis and understanding across diverse tasks. ✅ Text to Image ✅ Image to Depth ✅ Image to Segmentation ✅ Image to Pose ✅ FaceID ✅ Image to Multiview How to use & more👇

Gradio

11,820 просмотров • 1 год назад

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.
0:34

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,663 просмотров • 3 лет назад

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.
0:24

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,305 просмотров • 2 лет назад

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion
2:29

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,439 просмотров • 3 лет назад

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev
0:32

.Traslo shared a Super Hang-On-style racing prototype in Godot, recreating that classic pseudo-3D look using segmented tracks and projection for depth. 🏁 See the breakdown: #GodotEngine #gamedev

Jettelly Inc.

30,911 просмотров • 3 месяцев назад

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D
0:51

Daily #Blender Tip: If you have a model that fakes detail using a Normal map, it can be interesting to convert it to ‘real’ geometry that you can continue sculpting on, or for use in 3D printing. This shows you how to do it! #B3D

Jan van den Hemel

75,105 просмотров • 3 лет назад

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.
0:25

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

CHRIS FIRST

107,394 просмотров • 9 месяцев назад

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇
1:30

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇

Nikhil Keetha

123,025 просмотров • 11 месяцев назад