Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Doesn't look like the super low-res depth maps from the iPhone Pro's LiDAR sensor would be too useful as supervision (or sanity check) for recent monocular depth estimators.

chrisoffner3d's profile picture

Chris Offner

4,695 subscribers

66,094 görüntüleme • 2 yıl önce •via X (Twitter)

EğitimBilim & Teknoloji
LIVE

Anya Rossi• Live Now

Private livecam show

0 Yorum

Yorum bulunmuyor

Orijinal gönderinin yorumları burada görünecek

Benzer Videolar

For a more in-depth look at #MW3 Multiplayer Maps 👉
0:10

For a more in-depth look at #MW3 Multiplayer Maps 👉

Call of Duty

425,739 görüntüleme • 3 yıl önce

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.
0:15

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.

Keijiro Takahashi

15,208 görüntüleme • 1 yıl önce

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵
0:17

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵

Anton Obukhov

49,896 görüntüleme • 1 yıl önce

AI-Enhanced LiDAR. Left vs right. A real LiDAR device costs thousands of dollars. What's in your iPhone Pro is a "baby LiDAR". Limited depth resolution, noisy output, not really built for high-precision 3D. You can't change the hardware. So we built an ML layer on top. Denoising, geometry completion, detail recovery. Processed server-side. Same sensor. Very different result.
0:17

AI-Enhanced LiDAR. Left vs right. A real LiDAR device costs thousands of dollars. What's in your iPhone Pro is a "baby LiDAR". Limited depth resolution, noisy output, not really built for high-precision 3D. You can't change the hardware. So we built an ML layer on top. Denoising, geometry completion, detail recovery. Processed server-side. Same sensor. Very different result.

KIRI Engine - 3D Scanner App

51,866 görüntüleme • 5 ay önce

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️
0:16

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️

Alex Carlier

199,618 görüntüleme • 2 yıl önce

AnyDepth: Lightweight zero-shot monocular depth estimation; surpasses DPT; - nicely preserves detail.
0:17

AnyDepth: Lightweight zero-shot monocular depth estimation; surpasses DPT; - nicely preserves detail.

Wildminder

18,636 görüntüleme • 10 ay önce

Some updates on the multiview vistadream pipeline with Rerun! Rerun came in extremely useful here, as being able to visualize depths at each stage of the pipeline allowed me to debug some nasty bugs. Since the last time, I was only working with a single image input. I've added in VGGT as my multiview pose + depth estimator. It works REALLY well for getting camera poses, but the depths are not that great. To try and fix that, I estimated depth maps from MoGeV2 for each of the views, and scale+shift aligned them so that they would match up to the confident sections of VGGT's depth predictions. You can see in the video just how much sharper the visualized 2d depth maps are! The biggest issue continues to be the multiview consistency 🫠 That's up next, along with actually training the Gaussian splat. Lots of work went into actually understanding inputs+outputs for VGGT. I had some funky bugs where the confidence values would all collapse to true I'm also really excited for this pipeline to use Difix3D+ Nvidia instead of Flux Inpainting, it seems like a better suited for a multiview pipeline.
0:14

Some updates on the multiview vistadream pipeline with Rerun! Rerun came in extremely useful here, as being able to visualize depths at each stage of the pipeline allowed me to debug some nasty bugs. Since the last time, I was only working with a single image input. I've added in VGGT as my multiview pose + depth estimator. It works REALLY well for getting camera poses, but the depths are not that great. To try and fix that, I estimated depth maps from MoGeV2 for each of the views, and scale+shift aligned them so that they would match up to the confident sections of VGGT's depth predictions. You can see in the video just how much sharper the visualized 2d depth maps are! The biggest issue continues to be the multiview consistency 🫠 That's up next, along with actually training the Gaussian splat. Lots of work went into actually understanding inputs+outputs for VGGT. I had some funky bugs where the confidence values would all collapse to true I'm also really excited for this pipeline to use Difix3D+ Nvidia instead of Flux Inpainting, it seems like a better suited for a multiview pipeline.

Pablo Vela

29,904 görüntüleme • 1 yıl önce

Left: raw depth from the OAK-D Pro W camera Right: depth from FoundationStereo
0:11

Left: raw depth from the OAK-D Pro W camera Right: depth from FoundationStereo

Yu Xiang

32,598 görüntüleme • 8 ay önce

I added a node to my custom node that converts the depth image to a normal map! This is useful for 2D-style images where Normals Estimation doesn't work well.
0:16

I added a node to my custom node that converts the depth image to a normal map! This is useful for 2D-style images where Normals Estimation doesn't work well.

toyxyz

117,502 görüntüleme • 2 yıl önce

Trying out realtime video-to-depth on an iPhone 15 using Depth Anything V2.
0:18

Trying out realtime video-to-depth on an iPhone 15 using Depth Anything V2.

Tim Field

21,835 görüntüleme • 2 yıl önce

Video diffusion models are just overqualified depth estimators! Deterministic single-pass depth estimation based on WanV2.1. - SOTA 5.5 AbsRel on ScanNet - data-efficient than baselines; - no temporal flicker + infinite-length estimation w/ zero scale drift.
0:18

Video diffusion models are just overqualified depth estimators! Deterministic single-pass depth estimation based on WanV2.1. - SOTA 5.5 AbsRel on ScanNet - data-efficient than baselines; - no temporal flicker + infinite-length estimation w/ zero scale drift.

Wildminder

49,551 görüntüleme • 8 ay önce

How else would my fitness coach check my squat depth?
0:14

How else would my fitness coach check my squat depth?

Bryce Adams 💋

176,848 görüntüleme • 1 yıl önce

2024 LHP Mitchell Tarnowski 1st in depth look at the southpaw and it was impressive. 6-foot-2, clean arm, delivery works and showed feel for the zone. FB was 85-87 mph and played up / got consistent late offerings from hitters. Also showed feel for spin, breaking off a low 70s breaker with good depth.
0:18

2024 LHP Mitchell Tarnowski 1st in depth look at the southpaw and it was impressive. 6-foot-2, clean arm, delivery works and showed feel for the zone. FB was 85-87 mph and played up / got consistent late offerings from hitters. Also showed feel for spin, breaking off a low 70s breaker with good depth.

Prep Baseball Ohio

10,154 görüntüleme • 3 yıl önce

We live in a funny time. I asked Fable for Azure Kinect support on macOS: "Doesn't exist, the depth engine is a closed Windows/Linux binary" Me: "I know you can do it" Used the arm64 Linux build, booted it in a 182 MB VM, passed the sensor over USB C, streamed depth +IR back.
0:14

We live in a funny time. I asked Fable for Azure Kinect support on macOS: "Doesn't exist, the depth engine is a closed Windows/Linux binary" Me: "I know you can do it" Used the arm64 Linux build, booted it in a 182 MB VM, passed the sensor over USB C, streamed depth +IR back.

Renaud

27,179 görüntüleme • 2 ay önce

Raised from the depth WIP
0:12

Raised from the depth WIP

indifference

31,669 görüntüleme • 10 ay önce

Revisiting this game a few months later: (i) It's pretty impressive that general-purpose image generators can estimate meaningful depth from a single photo. (ii) Monocular depth remains pretty awful for 3D reconstruction! Here Gemini > GPT > Qwen. (At least I hope so!…🫣)
0:10

Revisiting this game a few months later: (i) It's pretty impressive that general-purpose image generators can estimate meaningful depth from a single photo. (ii) Monocular depth remains pretty awful for 3D reconstruction! Here Gemini > GPT > Qwen. (At least I hope so!…🫣)

Keenan Crane

34,217 görüntüleme • 6 ay önce