Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I prompted Omma to build a #threejs app with real dynamic lighting on a 3D mesh - generated from a single image, using Depth Anything v2 + Transformers from Hugging Face ⚡ Depth estimation in the browser 🫧 3D mesh from the depth map 💡 Dynamic lighting reacting to... show more

Joseph Azar

2,160 subscribers

14,041 Aufrufe • vor 4 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Ever wondered what the real women behind ancient Greek statues looked like? I brought them back to life using: - Depth Anything (depth maps) - Omma AI (Code and 3D implementation) - Three.js

Joseph Azar

74,695 Aufrufe • vor 3 Monaten

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

Project Light Touch from Adobe enables you to modify the lighting in any image. You can move the lighting anywhere within a scene in 3D space, adjusting its color, position, depth, and brightness.

CHRIS FIRST

107,394 Aufrufe • vor 10 Monaten

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.

I generated this 3D enviroment using a single image using "Marble" from World Labs. The new version can generate a mesh from the splat and is directly usable in Unreal Engine 5.7.

Matt Workman

42,460 Aufrufe • vor 9 Monaten

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors paper page: present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors. In the first stage, we optimize a neural radiance field to produce a coarse geometry. In the second stage, we adopt a memory-efficient differentiable mesh representation to yield a high-resolution mesh with a visually appealing texture. In both stages, the 3D content is learned through reference view supervision and novel views guided by a combination of 2D and 3D diffusion priors. We introduce a single trade-off parameter between the 2D and 3D priors to control exploration (more imaginative) and exploitation (more precise) of the generated geometry. Additionally, we employ textual inversion and monocular depth regularization to encourage consistent appearances across views and to prevent degenerate solutions, respectively. Magic123 demonstrates a significant improvement over previous image-to-3D techniques, as validated through extensive experiments on synthetic benchmarks and diverse real-world images.

AK

305,663 Aufrufe • vor 3 Jahren

Still experimenting with hand tracking 🖐️ using a webcam and the dear Carlo. The 3D model was generated from a single image in Omma AI Studio, and I remixed an Octopus demo to take advantage of the physics simulation. Building with AI these days is so much fun. Music also generated from the Studio (Fan Art) #threeJS

Still experimenting with hand tracking 🖐️ using a webcam and the dear Carlo. The 3D model was generated from a single image in Omma AI Studio, and I remixed an Octopus demo to take advantage of the physics simulation. Building with AI these days is so much fun. Music also generated from the Studio (Fan Art) #threeJS

Joseph Azar

74,480 Aufrufe • vor 2 Monaten

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

Depth is starting to feel less like an image… and more like geometry. InfiniDepth (open source) pushes exactly in that direction🤩 Depth is no longer just a map. It’s becoming a geometry representation. Single image → depth → 3DGS🥳 It’s not replacing real-world capture, but it’s definitely changing how image-to-3D works.

KIRI Engine - 3D Scanner App

26,777 Aufrufe • vor 5 Monaten

$.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:$

.FrogmanDev shared a cool trick for creating under-surface ice fracturing in 3D. The depth comes from real geometry:

80 LEVEL

34,685 Aufrufe • vor 4 Monaten

FABLE GENERATES A FULL 3D CITY IN A SINGLE PROMPT RUN Fable generated a complete, interactive 3D city in a single continuous run. With no step-by-step debugging or manual code splits, the model synthesized procedural building layouts, lighting, and spatial geometry in one go, proving its single-shot 3D web graphics capabilities.

FABLE GENERATES A FULL 3D CITY IN A SINGLE PROMPT RUN Fable generated a complete, interactive 3D city in a single continuous run. With no step-by-step debugging or manual code splits, the model synthesized procedural building layouts, lighting, and spatial geometry in one go, proving its single-shot 3D web graphics capabilities.

0xMarioNawfal

47,514 Aufrufe • vor 1 Monat

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,305 Aufrufe • vor 2 Jahren

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

VAST AI releases Triplane Meets Gaussian Splatting on Hugging Face Fast and Generalizable Single-View 3D Reconstruction with Transformers demo: TGS enables fast reconstruction from single-view image. It builds the 3D representation upon a hybrid Triplane-Gaussian representation by evaluating a transformer-based framework, from which 3D Gaussians would be decoded

AK

113,242 Aufrufe • vor 2 Jahren

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

In collaboration with Intel, our Depth Fusion showcases the power of our LDM3D diffusion model in generating 360° views from text prompts provided by the user. The LDM3D diffusion model generates a 2D RGB image and its corresponding relative depth map providing a complete RGBD representation corresponding to the text prompt. The LDM 3D model is a specialized version of the stable diffusion V 1.4 model that has been modified to fit both image and depth map data.The model was then fine tuned on a subset of the Laion400M data set - large scale image caption data set. The depth maps used to fine tune our model were generated by the DPTBeiT large 512 depth estimation model that provides highly accurate relative depth estimates for each pixel. We take the generated 2D RGB image and depth map and use them to compute a 360° projection using touchdesigner. Touchdesigner is a versatile platform that allows for the creation of immersive and interactive multimedia experiences. Our application harnesses the power of touchdesigner to bring the generated 360° views to life, providing users with a unique and engaging way to experience their text prompts, whether it’s a description of a tranquil forest, a noisy cityscape or a futuristic sci fi world. Our depth fusion can bring these concepts to life in a vivid and immersive detail. - Scottie Fox, VP Engineering Blockade Labs ScottieFox #AI #VR #3D #gamedev #stablediffusion

Blockade Labs

11,439 Aufrufe • vor 3 Jahren

Wild what's possible now: I can ship a 3D experience prototype to a museum in a single afternoon. Everything coded and generated with Omma, leveraging AI to iterate fast. 3D models generated in Omma. Scene built on top of Three.js. Prompted for dissolving shaders + particle systems?

Wild what's possible now: I can ship a 3D experience prototype to a museum in a single afternoon. Everything coded and generated with Omma, leveraging AI to iterate fast. 3D models generated in Omma. Scene built on top of Three.js. Prompted for dissolving shaders + particle systems?

Joseph Azar

93,557 Aufrufe • vor 3 Monaten

#ICCV2025 🤩3D world generation is cool, but it is cooler to play with the worlds using 3D actions 👆💨, and see what happens! — Introducing *WonderPlay*: Now you can create dynamic 3D scenes that respond to your 3D actions from a single image! Web: 🧵1/7

#ICCV2025 🤩3D world generation is cool, but it is cooler to play with the worlds using 3D actions 👆💨, and see what happens! — Introducing WonderPlay: Now you can create dynamic 3D scenes that respond to your 3D actions from a single image! Web: 🧵1/7

Hong-Xing (Koven) Yu

57,914 Aufrufe • vor 1 Jahr

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting

Excited to release our first public AI web app, powered by Apple’s open-source ML-SHARP model, capable of transforming a single image into a 3D Gaussian Splat with real depth understanding in seconds. Try it here → #AI #Apple #VR #GaussianSplatting

Niccolò Miranda

201,681 Aufrufe • vor 7 Monaten

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:

Bingyi Kang

67,706 Aufrufe • vor 1 Jahr

ViPE: Video Pose Engine for 3D Geometric Perception Contributions: • A robust and efficient framework, ViPE, for estimating camera parameters and dense depth from diverse, in-the-wild videos. • A system design that integrates the strengths of classical SLAM (efficiency, scalability) and learned models (robustness), with key improvements in efficiency, dynamic object handling, and depth quality over prior work. • A large-scale dataset of annotated videos, created using ViPE, to facilitate future research in 3D computer vision.

ViPE: Video Pose Engine for 3D Geometric Perception Contributions: • A robust and efficient framework, ViPE, for estimating camera parameters and dense depth from diverse, in-the-wild videos. • A system design that integrates the strengths of classical SLAM (efficiency, scalability) and learned models (robustness), with key improvements in efficiency, dynamic object handling, and depth quality over prior work. • A large-scale dataset of annotated videos, created using ViPE, to facilitate future research in 3D computer vision.

MrNeRF

42,553 Aufrufe • vor 1 Jahr

We also present another paper at @SIGGRAPH 2023 on neural implicit 3D Morphable Models that can be used to create a dynamic 3D avatar from a single in-the-wild image. (Lead author Connor Lin).

Koki Nagano

12,776 Aufrufe • vor 3 Jahren

MICROSOFT DROPPED A 4B PARAMETER MODEL THAT TURNS ONE IMAGE INTO A 3D ASSET IN 3 SECONDS and it's open source TRELLIS.2 fully textured, physically accurate 3D models with PBR textures out of the box not a rough mesh..not a placeholder roughness, metallic, opacity the kind of detail that makes things look real under any lighting and it handles the weird stuff too..open surfaces, hollow interiors, geometry that breaks every other tool the model doesn't know the word "limitation" apparently demo is live on hugging face right now

MICROSOFT DROPPED A 4B PARAMETER MODEL THAT TURNS ONE IMAGE INTO A 3D ASSET IN 3 SECONDS and it's open source TRELLIS.2 fully textured, physically accurate 3D models with PBR textures out of the box not a rough mesh..not a placeholder roughness, metallic, opacity the kind of detail that makes things look real under any lighting and it handles the weird stuff too..open surfaces, hollow interiors, geometry that breaks every other tool the model doesn't know the word "limitation" apparently demo is live on hugging face right now

Vaishnavi

354,971 Aufrufe • vor 4 Monaten

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇

Meet MapAnything – a transformer that directly regresses factored metric 3D scene geometry (from images, calibration, poses, or depth) in an end-to-end way. No pipelines, no extra stages. Just 3D geometry & cameras, straight from any type of input, delivering new state-of-the-art results 🚀 One universal model enables SoTA for: 🔥 Mono Depth Estimation 🔥 Multi-View SfM 🔥 Multi-View Stereo 🔥 Depth Completion 🔥 Registration … and many more possibilities! – plus everything is metric 🎯 We release code for data processing, training, benchmarking & ablations – everything Apache 2.0! Details & Links 👇

Nikhil Keetha

123,125 Aufrufe • vor 11 Monaten

Example of what AI generation can do in practice currently, from initial image (which is also generated) to a very detailed printable model, the level of detail mostly made possible with the Marigold depth estimation. #ai #3dprinting #dragon #technology

Example of what AI generation can do in practice currently, from initial image (which is also generated) to a very detailed printable model, the level of detail mostly made possible with the Marigold depth estimation. #ai #3dprinting #dragon #technology

Jukka Seppänen

13,811 Aufrufe • vor 2 Jahren