Загрузка видео...

Не удалось загрузить видео

На главную

Thrilled to introduce Video Depth Anything to support Depth Estimation for super-long videos (over 5 minutes). 👉It enjoys all the benefits of #DepthAnything: high-quality, fast, robust, etc. Proj Page:

bingyikang's profile picture

Bingyi Kang

1,111 subscribers

25,464 просмотров • 1 год назад •via X (Twitter)

ИскусствоНаука и технологииОбразование#DepthAnything
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 6

Фото профиля Bingyi Kang
Bingyi Kang1 год назад

Arxiv: Code: HuggingFace Demo: Thank again for the generous support of @huggingface @pcuenq @_akhaliq in severing our demo.

Фото профиля Suppybird Kingdom
Suppybird Kingdom1 год назад

Thank you. Very useful <3

Фото профиля Jonathan Granskog
Jonathan Granskog1 год назад

looks great! congrats!

Фото профиля Aradhye Agarwal
Aradhye Agarwal1 год назад

Hi, great work! Could you share the link to the RGB videos?

Фото профиля Leor Cohen
Leor Cohen1 год назад

Looks amazing! 🔥

Фото профиля AIサポートで楽しく小説を書こう。NovelShaft
AIサポートで楽しく小説を書こう。NovelShaft1 год назад

素晴らしいプロジェクトですね！ビデオの深度推定に興味があります 😊

Похожие видео

Introducing MegaSaM! 🎥 Accurate, fast, & robust structure + camera estimation from casual monocular videos of dynamic scenes! MegaSaM outputs camera parameters and consistent video depth, scaling to long videos with unconstrained camera paths and complex scene dynamics!
2:00

Introducing MegaSaM! 🎥 Accurate, fast, & robust structure + camera estimation from casual monocular videos of dynamic scenes! MegaSaM outputs camera parameters and consistent video depth, scaling to long videos with unconstrained camera paths and complex scene dynamics!

Zhengqi Li

57,010 просмотров • 1 год назад

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:
1:20

Want to use Depth Anything, but need metric depth rather than relative depth? Thrilled to introduce Prompt Depth Anything, a new paradigm for accurate metric depth estimation with up to 4K resolution. 👉Key Message: Depth foundation models like DA have already internalized rich geometric knowledge of the 3D world but lack a proper way to elicit it. Inspired by the success of prompting in LLMs, we propose prompting Depth Anything with metric cues to produce metric depth. This method proves to be very effective when using a low-cost lidar (e.g., iPhone's LiDAR), which is widely available, as prompts. We believe the prompt can generalize to other forms as long as scale information is provided. Prompt Depth Anything offers 1⃣A series of models for iPhone lidars. 2⃣4D reconstruction from monocular videos (captured with iPhone). 3⃣Improved generalization ability for robot manipulation, e.g. Training on cans but generalizing on glasses. 4⃣More detailed depth annotations for the ScanNet++ dataset. The first author is our excellent intern Haotong Lin. Paper: Huggingface: Project Page: Code:

Bingyi Kang

67,604 просмотров • 1 год назад

After a year of team work, we're thrilled to introduce Depth Anything 3 (DA3)! 🚀 Aiming for human-like spatial perception, DA3 extends monocular depth estimation to any-view scenarios, including single images, multi-view images, and video. In pursuit of minimal modeling, DA3 reveals two key insights: 💎 A plain transformer (e.g., vanilla DINO) is enough. No specialized architecture. ✨ A single depth-ray representation is enough. No complex 3D tasks. Three series of models have been released: the main DA3 series, a monocular metric estimation series, and a monocular depth estimation series. The core team members, aside from me: Haotong Lin, Sili Chen, Jun Hao Liew, Donny Y. Chen. 👇(1/n) #DepthAnything3
0:32

After a year of team work, we're thrilled to introduce Depth Anything 3 (DA3)! 🚀 Aiming for human-like spatial perception, DA3 extends monocular depth estimation to any-view scenarios, including single images, multi-view images, and video. In pursuit of minimal modeling, DA3 reveals two key insights: 💎 A plain transformer (e.g., vanilla DINO) is enough. No specialized architecture. ✨ A single depth-ray representation is enough. No complex 3D tasks. Three series of models have been released: the main DA3 series, a monocular metric estimation series, and a monocular depth estimation series. The core team members, aside from me: Haotong Lin, Sili Chen, Jun Hao Liew, Donny Y. Chen. 👇(1/n) #DepthAnything3

Bingyi Kang

515,348 просмотров • 9 месяцев назад

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.
0:24

Extract accurate depth from your 3D gaussians! Fast, accurate, and easy to use. Code of RaDe-GS is released! project page: code: paper: No need to change your 3D GS representations, we propose a play-and-plug rasterizer to extract accurate depth and normal from 3D gaussians, leading to the possibility of high-quality geometry reconstruction. It's quite efficient and fast, achieving 0.69mm errors on DTU dataset in only 5 minutes. Very easy to adopt the rasterizer in your any 3dgs projects.

Xiao-Xiao Long

31,305 просмотров • 2 лет назад

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl
0:40

Took it further with Omma AI, (Spline ) now it works on video, and everything working in a Web Browser. Drop a video, Depth Anything v2 calculates the depth map frame by frame, and Three.js renders a fully lit 3D mesh in real time. Depth estimation on video in the browser +Automatic baking pass + Dynamic lighting reacting to the geometry #vibecoding #threejs #webgl

Joseph Azar

148,148 просмотров • 3 месяцев назад

Here’s a sneak peek using Rerun and Gradio for data annotation. It uses Video Depth Anything and Segment Anything 2 under the hood to generate segmentation masks and depth maps/point clouds. More to share next week.
0:30

Here’s a sneak peek using Rerun and Gradio for data annotation. It uses Video Depth Anything and Segment Anything 2 under the hood to generate segmentation masks and depth maps/point clouds. More to share next week.

Pablo Vela

36,719 просмотров • 1 год назад

ViPE: Video Pose Engine for 3D Geometric Perception Contributions: • A robust and efficient framework, ViPE, for estimating camera parameters and dense depth from diverse, in-the-wild videos. • A system design that integrates the strengths of classical SLAM (efficiency, scalability) and learned models (robustness), with key improvements in efficiency, dynamic object handling, and depth quality over prior work. • A large-scale dataset of annotated videos, created using ViPE, to facilitate future research in 3D computer vision.
0:22

ViPE: Video Pose Engine for 3D Geometric Perception Contributions: • A robust and efficient framework, ViPE, for estimating camera parameters and dense depth from diverse, in-the-wild videos. • A system design that integrates the strengths of classical SLAM (efficiency, scalability) and learned models (robustness), with key improvements in efficiency, dynamic object handling, and depth quality over prior work. • A large-scale dataset of annotated videos, created using ViPE, to facilitate future research in 3D computer vision.

MrNeRF

42,553 просмотров • 1 год назад

Your robot can now see in depth 👀📏 LeRobot v0.6.0 adds real end-to-end depth support. Plug in an Intel RealSense, set use_depth: true, and depth maps join your RGB observations automatically: captured in millimeters, compressed into compact 12-bit depth video alongside your normal camera streams, and decoded back to physical units at training time. Depth renders live while you record and in the dataset viewer, and it works across SO-100/101, Koch, OpenArm, reBot, Unitree G1 and more. You also get full control over how everything gets encoded, RGB or depth, codec, quality, presets, all of it. More on how it works:
0:46

Your robot can now see in depth 👀📏 LeRobot v0.6.0 adds real end-to-end depth support. Plug in an Intel RealSense, set use_depth: true, and depth maps join your RGB observations automatically: captured in millimeters, compressed into compact 12-bit depth video alongside your normal camera streams, and decoded back to physical units at training time. Depth renders live while you record and in the dataset viewer, and it works across SO-100/101, Koch, OpenArm, reBot, Unitree G1 and more. You also get full control over how everything gets encoded, RGB or depth, codec, quality, presets, all of it. More on how it works:

LeRobot

30,480 просмотров • 28 дней назад

Introducing Modality Forcing, a recipe for post-training T2I models for SOTA RGB-Depth generation! Text-to-image (T2I) models learn rich representations of the spatial world. How do we build on this prior for high-quality depth generation? 🧵 [1/6]
0:25

Introducing Modality Forcing, a recipe for post-training T2I models for SOTA RGB-Depth generation! Text-to-image (T2I) models learn rich representations of the spatial world. How do we build on this prior for high-quality depth generation? 🧵 [1/6]

Bardienus Duisterhof

65,041 просмотров • 2 месяцев назад

Happy Chinese New Year, and thank you all for your love and support over the past year. On the last day of the Chinese Lunar Calendar year of 2024, we are thrilled to introduce to you the Blender plugin for Hunyun3D 2.0. Enjoy yourself!
1:17

Happy Chinese New Year, and thank you all for your love and support over the past year. On the last day of the Chinese Lunar Calendar year of 2024, we are thrilled to introduce to you the Blender plugin for Hunyun3D 2.0. Enjoy yourself!

Tencent Hy

82,856 просмотров • 1 год назад

Working on room scan streaming for the Lasertag game: headsets build a shared heightmap of the playspace collaboratively in the background. Quest's depth estimation is only good up to ~5 meters, so this lets people fight at greater distances
0:43

Working on room scan streaming for the Lasertag game: headsets build a shared heightmap of the playspace collaboratively in the background. Quest's depth estimation is only good up to ~5 meters, so this lets people fight at greater distances

jt

14,474 просмотров • 1 год назад

New Video! Excited to share our work on fast view synthesis of casual videos. 🤩 high-quality dynamic view synthesis 🤩 applicable for a wide range of casual videos 🤩 fast training and rendering
1:02

New Video! Excited to share our work on fast view synthesis of casual videos. 🤩 high-quality dynamic view synthesis 🤩 applicable for a wide range of casual videos 🤩 fast training and rendering

Jia-Bin Huang

27,360 просмотров • 2 лет назад

Monica Long | Benefits of Ripple $ Stablecoin 1. Reduces volatility of native crypto for transacting 2. Uses a global blockchain rail 24x7 4. Nearly free 👉Expect Ripple to keep innovating for #XRPL. 👉Next challenge: Create breadth and depth of liquidity in key currency pairs.
2:41

Monica Long | Benefits of Ripple $ Stablecoin 1. Reduces volatility of native crypto for transacting 2. Uses a global blockchain rail 24x7 4. Nearly free 👉Expect Ripple to keep innovating for #XRPL. 👉Next challenge: Create breadth and depth of liquidity in key currency pairs.

🌸Eri ~ Carpe Diem

18,593 просмотров • 1 год назад

SEI creator fund round 5 voting is live! This round 5 is all about creating visual content (short/long videos, livestream, etc...) What I will be doing in this round 5 - Tutorials - Livestreams - Entertaining videos These are the tools I propose using the fund for: - A good camera - Lights - Quality wireless/table mic - A Laptop for video editing With y'all support, all of these will be achievable... Support me with a vote ✅ How to vote: - Fund your $SEI wallet - Go to - Add my project/project to cart - Go to your cart - Input the amount of $sei you want to donate (minimum of $1) - Confirm your donation Done ✅
1:13

SEI creator fund round 5 voting is live! This round 5 is all about creating visual content (short/long videos, livestream, etc...) What I will be doing in this round 5 - Tutorials - Livestreams - Entertaining videos These are the tools I propose using the fund for: - A good camera - Lights - Quality wireless/table mic - A Laptop for video editing With y'all support, all of these will be achievable... Support me with a vote ✅ How to vote: - Fund your $SEI wallet - Go to - Add my project/project to cart - Go to your cart - Input the amount of $sei you want to donate (minimum of $1) - Confirm your donation Done ✅

MhiztaL⭕EL 💎 🔴

12,459 просмотров • 1 год назад

full video, $10 hardware, this was just a proof of concept as well. Its going to get a lot better. If your research lab or startup wants wide angle high quality depth for cheap, message me.
0:23

full video, $10 hardware, this was just a proof of concept as well. Its going to get a lot better. If your research lab or startup wants wide angle high quality depth for cheap, message me.

brian-machado-high-inference

422,958 просмотров • 9 месяцев назад

“This train is so fast that it can travel from Kumasi to Accra in just 1 hour and 30 minutes. This is the kind of train President Mahama is trying to introduce in Ghana.” — Ghanaian actor Kwaku Manu shares a video of a high-speed train abroad, saying it represents the type of fast and modern train service President Mahama intends to introduce in Ghana. 🎥: Kwaku Manu
1:58

“This train is so fast that it can travel from Kumasi to Accra in just 1 hour and 30 minutes. This is the kind of train President Mahama is trying to introduce in Ghana.” — Ghanaian actor Kwaku Manu shares a video of a high-speed train abroad, saying it represents the type of fast and modern train service President Mahama intends to introduce in Ghana. 🎥: Kwaku Manu

𝐀𝐒𝐊

49,215 просмотров • 20 дней назад

We used to take music like this for granted back in the 70’s and 80’s. Now, when you hear it decades later, it seems to have an extra depth of colour and quality…
3:00

We used to take music like this for granted back in the 70’s and 80’s. Now, when you hear it decades later, it seems to have an extra depth of colour and quality…

🌸🎵 Beautiful Melody 🎶💖

26,940 просмотров • 3 месяцев назад

Some video (from Dan Kraker ) of the Lester River in Duluth running high and fast thanks to 5"+ of rain over the weekend.
0:21

Some video (from Dan Kraker ) of the Lester River in Duluth running high and fast thanks to 5"+ of rain over the weekend.

Cathy Wurzer

32,103 просмотров • 2 лет назад

It feels profoundly weird to not be working on Black Ops 7 In Depth this year. I used to make these kind of videos every day, for over a decade. So it feels like a part of me is missing.
10:38

It feels profoundly weird to not be working on Black Ops 7 In Depth this year. I used to make these kind of videos every day, for over a decade. So it feels like a part of me is missing.

Drift0r

61,356 просмотров • 9 месяцев назад

After a year of Design & Development, I'm thrilled to introduce The Pillhead 📦 This limited collection of 111 high-quality resin figurines is my first-ever physical drop, ready to be shipped. Fill out the form below to secure your spot! This is a milestone for me, and I'm honored to have you on this journey. Thank you for your support. #IPWT🥂 With 💜 CFW
1:19

After a year of Design & Development, I'm thrilled to introduce The Pillhead 📦 This limited collection of 111 high-quality resin figurines is my first-ever physical drop, ready to be shipped. Fill out the form below to secure your spot! This is a milestone for me, and I'm honored to have you on this journey. Thank you for your support. #IPWT🥂 With 💜 CFW

CFW •ᴗ•

18,435 просмотров • 2 лет назад