正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

Trying out realtime video-to-depth on an iPhone 15 using Depth Anything V2.

Tim Field

5,302 subscribers

21,835 次观看 • 2 年前 •via X (Twitter)

科学技术教育

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

improving my 3D hand tracking template by adding depth-anything-v2 using mediapipe for X/Y movement and depth-anything for Z movement here i'm controlling a threejs scene in realtime with input from a single webcam

improving my 3D hand tracking template by adding depth-anything-v2 using mediapipe for X/Y movement and depth-anything for Z movement here i'm controlling a threejs scene in realtime with input from a single webcam

AA

28,216 次观看 • 2 个月前

in case you forgot: depth of field works in realtime on the web #threejs

in case you forgot: depth of field works in realtime on the web #threejs

Chase Davis

72,698 次观看 • 1 年前

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.

Keijiro Takahashi

15,208 次观看 • 1 年前

Trying out our WebGL-based NeRF tech on iridescent materials at the Kelvingrove – this is running realtime and interactively on an iPhone! You can play with it yourself here

Trying out our WebGL-based NeRF tech on iridescent materials at the Kelvingrove – this is running realtime and interactively on an iPhone! You can play with it yourself here

🌈 George Corney

19,447 次观看 • 3 年前

Wasn't easy to make him focus on work. Since this is audio-to-video, he would start dancing to the music like he's the star of an iPhone ad. Had to use "human motion transfer". Anything else like "depth transfer", "canny transfer", my man would jump right into the dance routine

Wasn't easy to make him focus on work. Since this is audio-to-video, he would start dancing to the music like he's the star of an iPhone ad. Had to use "human motion transfer". Anything else like "depth transfer", "canny transfer", my man would jump right into the dance routine

cocktail peanut

17,196 次观看 • 5 个月前

This is how a river depth is measured using an aircraft and a laser beam. The bathymetric LiDAR can measure depths upto 40m with a accuracy of about 15 cm

This is how a river depth is measured using an aircraft and a laser beam. The bathymetric LiDAR can measure depths upto 40m with a accuracy of about 15 cm

HOW THINGS WORK

553,964 次观看 • 2 年前

Doesn't look like the super low-res depth maps from the iPhone Pro's LiDAR sensor would be too useful as supervision (or sanity check) for recent monocular depth estimators.

Doesn't look like the super low-res depth maps from the iPhone Pro's LiDAR sensor would be too useful as supervision (or sanity check) for recent monocular depth estimators.

Chris Offner

66,034 次观看 • 1 年前

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️

Alex Carlier

199,524 次观看 • 2 年前

BIG NEWS. Blender 4.1 has realtime multipass of the Zdepth - meaning you can now viewport composite with depth in realtime! Exciting time. And.. it happenstance will also be in Bforaritsts 4.0.1.

BIG NEWS. Blender 4.1 has realtime multipass of the Zdepth - meaning you can now viewport composite with depth in realtime! Exciting time. And.. it happenstance will also be in Bforaritsts 4.0.1.

Trinumedia

16,245 次观看 • 2 年前

ambient scan experimenting with video depth map

ambient scan experimenting with video depth map

Kat ⊷ the Poet Engineer

56,793 次观看 • 1 年前

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 次观看 • 1 年前

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵

Anton Obukhov

49,830 次观看 • 1 年前

Handbrake Off song choice for tomorrow locked in. Shout out to squad depth

Handbrake Off song choice for tomorrow locked in. Shout out to squad depth

Art de Roché

15,770 次观看 • 9 个月前

Retro v2: an *updated* iPod Classic experience for iPhone 🎵 TestFlight: Feel free to come on in if you’ve got Spotify :)

Retro v2: an updated iPod Classic experience for iPhone 🎵 TestFlight: Feel free to come on in if you’ve got Spotify :)

Sakun

881,888 次观看 • 3 年前

Video diffusion models are just overqualified depth estimators! Deterministic single-pass depth estimation based on WanV2.1. - SOTA 5.5 AbsRel on ScanNet - data-efficient than baselines; - no temporal flicker + infinite-length estimation w/ zero scale drift.

Video diffusion models are just overqualified depth estimators! Deterministic single-pass depth estimation based on WanV2.1. - SOTA 5.5 AbsRel on ScanNet - data-efficient than baselines; - no temporal flicker + infinite-length estimation w/ zero scale drift.

Wildminder

49,251 次观看 • 3 个月前

Olivia Rodrigo’s anthemic music video for “get him back!” shot entirely on the new iPhone 15 Pro using features like Pro Res 4K Log and USB-C external drive compatibility. And 5x zoom on iPhone 15 Pro Max. Available for pre-order 9/15.

Olivia Rodrigo’s anthemic music video for “get him back!” shot entirely on the new iPhone 15 Pro using features like Pro Res 4K Log and USB-C external drive compatibility. And 5x zoom on iPhone 15 Pro Max. Available for pre-order 9/15.

Apple

11,079,513 次观看 • 2 年前

Mario characters have no depth at all so every time someone tries to give them anything it always feels like this

Mario characters have no depth at all so every time someone tries to give them anything it always feels like this

diossaro 🐢👁💻

248,020 次观看 • 2 个月前

"I am excited to share an in-depth look at the making of the Abracadabra video with you, coming tomorrow. " - Lady Gaga via Instagram

"I am excited to share an in-depth look at the making of the Abracadabra video with you, coming tomorrow. " - Lady Gaga via Instagram

LⱯDY GⱯGⱯ NOW🪞

120,676 次观看 • 1 年前