Loading video...

Video Failed to Load

Go Home

Trying out realtime video-to-depth on an iPhone 15 using Depth Anything V2.

nobbis's profile picture

Tim Field

5,302 subscribers

21,835 views • 2 years ago •via X (Twitter)

Science & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

improving my 3D hand tracking template by adding depth-anything-v2 using mediapipe for X/Y movement and depth-anything for Z movement here i'm controlling a threejs scene in realtime with input from a single webcam
0:15

improving my 3D hand tracking template by adding depth-anything-v2 using mediapipe for X/Y movement and depth-anything for Z movement here i'm controlling a threejs scene in realtime with input from a single webcam

AA

28,319 views • 4 months ago

Depth anything v2 vs. Ultralytics YOLO26 depth | Speed comparison 🚀 For this demo, I compared yolo26m-depth with depth-anything-v2-small on an NVIDIA RTX 3050 using the same input settings. Even though I used the medium YOLO26 model, it delivered nearly 2× the throughput: 22 FPS vs. 11 FPS. #Vehicles #MachineLearning #Research
0:14

Depth anything v2 vs. Ultralytics YOLO26 depth | Speed comparison 🚀 For this demo, I compared yolo26m-depth with depth-anything-v2-small on an NVIDIA RTX 3050 using the same input settings. Even though I used the medium YOLO26 model, it delivered nearly 2× the throughput: 22 FPS vs. 11 FPS. #Vehicles #MachineLearning #Research

Muhammad Rizwan Munawar

22,019 views • 14 days ago

A new stable motion transfer workflow for Seedance 2.0! We built a video-to-depth-video + skeleton-binding Skill based on "Depth-Anything-V2" for motion transfer. Tell your agent to help me create a Skill that converts a normal video into a depth video with skeleton binding. Motion transfer can be achieved with only the following prompt + content description:
0:15

A new stable motion transfer workflow for Seedance 2.0! We built a video-to-depth-video + skeleton-binding Skill based on "Depth-Anything-V2" for motion transfer. Tell your agent to help me create a Skill that converts a normal video into a depth video with skeleton binding. Motion transfer can be achieved with only the following prompt + content description:

Buzzy Now

12,521 views • 21 days ago

in case you forgot: depth of field works in realtime on the web #threejs
0:10

in case you forgot: depth of field works in realtime on the web #threejs

Chase Davis

72,698 views • 1 year ago

🤯 Depth videos perfectly solve false flags on reference videos — and can perfectly recreate both martial arts and dance! Turned a Guan Dao martial arts clip into a Depth motion reference, swapped the fighter for a market auntie, and moved the scene to a T-junction inside a local market 🤣 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. This goes way beyond trending dances. Martial arts, polearms, and other complex movements can all be transferred cleanly with Depth! Workflow + Prompt below 👇
0:14

🤯 Depth videos perfectly solve false flags on reference videos — and can perfectly recreate both martial arts and dance! Turned a Guan Dao martial arts clip into a Depth motion reference, swapped the fighter for a market auntie, and moved the scene to a T-junction inside a local market 🤣 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. This goes way beyond trending dances. Martial arts, polearms, and other complex movements can all be transferred cleanly with Depth! Workflow + Prompt below 👇

Larus Canus

50,377 views • 1 month ago

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.
0:15

VFX using iPhone LiDAR. The great thing about DoF particles is that they easily add a sense of depth to the effects.

Keijiro Takahashi

15,208 views • 1 year ago

Trying out our WebGL-based NeRF tech on iridescent materials at the Kelvingrove – this is running realtime and interactively on an iPhone! You can play with it yourself here
0:15

Trying out our WebGL-based NeRF tech on iridescent materials at the Kelvingrove – this is running realtime and interactively on an iPhone! You can play with it yourself here

🌈 George Corney

19,447 views • 3 years ago

🤯 I didn’t expect Depth to track rooftop parkour this cleanly! Used a fast climbing clip as the motion reference, then swapped in a student with twin tails and a backpack on a coastal school rooftop. The running path, wall contact, jumps, landings, and full-body continuity all hold together surprisingly well. 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. Depth opens up a lot more possibilities for parkour, climbing, martial arts, dance, and other complex full-body motion. Workflow + Prompt below 👇
0:13

🤯 I didn’t expect Depth to track rooftop parkour this cleanly! Used a fast climbing clip as the motion reference, then swapped in a student with twin tails and a backpack on a coastal school rooftop. The running path, wall contact, jumps, landings, and full-body continuity all hold together surprisingly well. 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. Depth opens up a lot more possibilities for parkour, climbing, martial arts, dance, and other complex full-body motion. Workflow + Prompt below 👇

Larus Canus

24,613 views • 27 days ago

Wasn't easy to make him focus on work. Since this is audio-to-video, he would start dancing to the music like he's the star of an iPhone ad. Had to use "human motion transfer". Anything else like "depth transfer", "canny transfer", my man would jump right into the dance routine
0:10

Wasn't easy to make him focus on work. Since this is audio-to-video, he would start dancing to the music like he's the star of an iPhone ad. Had to use "human motion transfer". Anything else like "depth transfer", "canny transfer", my man would jump right into the dance routine

cocktail peanut

17,196 views • 7 months ago

🤯 Depth can now recreate complex climbing and parkour motion this cleanly! Turned a fast climbing clip into a Depth motion reference, then swapped in a 20-year-old twin-tail student with a backpack while keeping the same concrete structure. Wall contact, weight shifts, jumps, climbing paths, and full-body movement all stay surprisingly clean and consistent! 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. Dance, martial arts, climbing, parkour, and other complex movements can all be transferred cleanly with Depth! Workflow + Prompt below 👇
0:15

🤯 Depth can now recreate complex climbing and parkour motion this cleanly! Turned a fast climbing clip into a Depth motion reference, then swapped in a 20-year-old twin-tail student with a backpack while keeping the same concrete structure. Wall contact, weight shifts, jumps, climbing paths, and full-body movement all stay surprisingly clean and consistent! 🌟 Workflow: 1. Pick a reference clip under 15 seconds 2. Convert it to Depth with Depth Anything V2 3. Generate a new character + scene 4. Feed everything into Seedance with the prompt below 🌟 Depth video conversion: You can build a local Depth converter with Codex — prompt in the comments. Dance, martial arts, climbing, parkour, and other complex movements can all be transferred cleanly with Depth! Workflow + Prompt below 👇

Larus Canus

106,715 views • 28 days ago

New drop: Options Market Depth V2 🔥 • Bookmap-style depth + trade flow • Stack charts horizontally, vertically, or grid. • Built on TradingView lightweight-charts Open source & free → code in next post. #Schwab
0:10

New drop: Options Market Depth V2 🔥 • Bookmap-style depth + trade flow • Stack charts horizontally, vertically, or grid. • Built on TradingView lightweight-charts Open source & free → code in next post. #Schwab

Nick

11,255 views • 1 year ago

New fal workflow: video restyling with Video Depth Anything and Seedance 2.0 - Restyle the first frame into your target look - Extract consistent depth across the source video - Use that depth to guide Seedance 2.0 through the full sequence - Preserve the original motion and composition while transforming the visual style A simple workflow for turning existing footage into stylized video.
0:16

New fal workflow: video restyling with Video Depth Anything and Seedance 2.0 - Restyle the first frame into your target look - Extract consistent depth across the source video - Use that depth to guide Seedance 2.0 through the full sequence - Preserve the original motion and composition while transforming the visual style A simple workflow for turning existing footage into stylized video.

fal

10,909 views • 1 month ago

This is how a river depth is measured using an aircraft and a laser beam. The bathymetric LiDAR can measure depths upto 40m with a accuracy of about 15 cm
0:14

This is how a river depth is measured using an aircraft and a laser beam. The bathymetric LiDAR can measure depths upto 40m with a accuracy of about 15 cm

HOW THINGS WORK

553,964 views • 2 years ago

Neat realtime VFX trick by TUATARA ➡️ Gamescom : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine
0:10

Neat realtime VFX trick by TUATARA ➡️ Gamescom : combine depth masking with bump offset to project sprites onto geometry while preserving scene depth. Great for fake lighting, UI indicators, hit impacts, and damage overlays—simple idea, tons of mileage. #realtimeVFX #UnrealEngine

indieforgames

13,472 views • 1 month ago

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️
0:16

Google just revealed an ABSOLUTE depth estimation model 🤯 As opposed to recent depth models (Marigold, PatchFusion) which aim for maximum details, DMD aims to estimate the ABSOLUTE depth (in meters) within the image More details below ⬇️⬇️

Alex Carlier

199,562 views • 2 years ago

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.
0:13

Depth Any Video with Scalable Synthetic Data AI physicists and chemists continue to make strides in depth estimation from video. Check out this new paper featuring some impressive examples. See the thread for more details (unfortunately no code yet). Abstract: Video depth estimation has long been hindered by the scarcity of consistent and scalable ground truth data, leading to inconsistent and unreliable results. In this paper, we introduce Depth Any Video, a model that tackles the challenge through two key innovations. First, we develop a scalable synthetic data pipeline, capturing real-time video depth data from diverse game environments, yielding 40,000 video clips of 5-second duration, each with precise depth annotations. Second, we leverage the powerful priors of generative video diffusion models to handle real-world videos effectively, integrating advanced techniques such as rotary position encoding and flow matching to further enhance flexibility and efficiency. Unlike previous models, which are limited to fixed-length video sequences, our approach introduces a novel mixed-duration training strategy that handles videos of varying lengths and performs robustly across different frame rates 0 - even on single frames. At inference, we propose a depth interpolation method that enables our model to infer high-resolution video depth across sequences of up to 150 frames. Our model outperforms all previous generative depth models in terms of spatial accuracy and temporal consistency.

MrNeRF

27,428 views • 1 year ago

Retro v2: an *updated* iPod Classic experience for iPhone 🎵 TestFlight: Feel free to come on in if you’ve got Spotify :)
0:15

Retro v2: an *updated* iPod Classic experience for iPhone 🎵 TestFlight: Feel free to come on in if you’ve got Spotify :)

Sakun

882,191 views • 3 years ago

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵
0:17

Introducing 🛹 RollingDepth 🛹 — a universal monocular depth estimator for arbitrarily long videos! Our paper, “Video Depth without Video Models,” delivers exactly that, setting new standards in temporal consistency. Check out more details in the thread 🧵

Anton Obukhov

49,860 views • 1 year ago

Handbrake Off song choice for tomorrow locked in. Shout out to squad depth
0:17

Handbrake Off song choice for tomorrow locked in. Shout out to squad depth

Art de Roché

15,770 views • 11 months ago