Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

monocular vision is wild one camera stream, estimating motion and sparse 3D structure from changing pixels alone

tetsuo

232,521 subscribers

29,464 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

MoCapAnything Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos

MoCapAnything Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos

AK

36,954 views • 5 months ago

Share our recent work - TrackingWorld: World-centric Monocular 3D Tracking of Almost All Pixels [NeurIPS'25] An optimization-based 3D tracking of all pixels. Code: Webpage: Welcome to try it! A feedforward version is on the way!

Share our recent work - TrackingWorld: World-centric Monocular 3D Tracking of Almost All Pixels [NeurIPS'25] An optimization-based 3D tracking of all pixels. Code: Webpage: Welcome to try it! A feedforward version is on the way!

Yuan Liu

12,158 views • 5 months ago

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

AK

77,162 views • 2 years ago

~30ms greedy path planning from monocular vision

~30ms greedy path planning from monocular vision

chester

19,100 views • 10 months ago

TONIC DNA created the 3D animations for JUMP 2.0 using a single phone. Move One is a single-camera motion capture app powered by AI. No suits required. It's never been easier for creative teams to bring their vision to life.

TONIC DNA created the 3D animations for JUMP 2.0 using a single phone. Move One is a single-camera motion capture app powered by AI. No suits required. It's never been easier for creative teams to bring their vision to life.

Move AI

13,531 views • 2 years ago

It’s never been easier for 3D animators to bring their creative vision to life. This is motion capture powered by AI. No suits or markers needed. You can now capture multiple people anywhere using standard cameras, and Move AI will generate 3D motion data from the 2D video.

It’s never been easier for 3D animators to bring their creative vision to life. This is motion capture powered by AI. No suits or markers needed. You can now capture multiple people anywhere using standard cameras, and Move AI will generate 3D motion data from the 2D video.

Move AI

116,379 views • 2 years ago

The eyes of the chameleon provide 360 degree vision due to unique eye anatomy and an ability to transition between monocular and binocular vision.

The eyes of the chameleon provide 360 degree vision due to unique eye anatomy and an ability to transition between monocular and binocular vision.

Nature is Amazing ☘️

2,580,351 views • 2 years ago

I am getting super excited to share my workflow for sending the After Effects 3D Motion Tracked Camera to Unreal Engine and then bringing the 3D renders back to AE for compositing. It will be a free tutorial NEXT WEEK from School of Motion.

I am getting super excited to share my workflow for sending the After Effects 3D Motion Tracked Camera to Unreal Engine and then bringing the 3D renders back to AE for compositing. It will be a free tutorial NEXT WEEK from School of Motion.

Aharon Rabinowitz

13,023 views • 1 year ago

One of the Super Meat Boy 3D prototype levels. Our first test with a fixed camera angle. No 45° angles and weird camera movement. Super motion-sickness inducing, hard to control…but it led us to the final camera setup.

One of the Super Meat Boy 3D prototype levels. Our first test with a fixed camera angle. No 45° angles and weird camera movement. Super motion-sickness inducing, hard to control…but it led us to the final camera setup.

Sluggerfly

110,073 views • 3 months ago

Editor's Loop- Motion Had fun exploring 3d camera and a lot more inside after effects. #aftereffects #motiongraphics #motiondesign

Editor's Loop- Motion Had fun exploring 3d camera and a lot more inside after effects. #aftereffects #motiongraphics #motiondesign

Shubh

12,877 views • 1 year ago

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3 on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT optimization + #ROS2 integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner

Gave a robot 3D vision with just a regular camera👁️ Full Tutorial: Deployed #Depth Anything V3 on NVIDIA Robotics Jetson AGX Orin. It estimates depth from 2D images in real-time—no special sensors needed. Just need #Monocular depth estimation + #TensorRT optimization + #ROS2 integration. 👉 Learn more about reComputer Robotics J5011: #TheAIHardwarePartner

Seeed Studio

16,966 views • 3 months ago

Find distances easily using the Monocular Pro Vision Laser Rangefinder Telescope

Find distances easily using the Monocular Pro Vision Laser Rangefinder Telescope

Bzhxyz

23,656 views • 7 months ago

Kling AI 1.5 Motion Brush is incredible. You can give different motions to multiple subjects in the same scene. Game changing control and quality 6 wild examples:

Kling AI 1.5 Motion Brush is incredible. You can give different motions to multiple subjects in the same scene. Game changing control and quality 6 wild examples:

Min Choi

493,613 views • 1 year ago

We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: abs: project: The demo is below:

We have released the code and weights for our #CVPR2023 paper "Avatars Grow Legs: Generating Smooth Human Motion from Sparse Tracking Inputs with Diffusion Model"! code: abs: project: The demo is below:

Artsiom Sanakoyeu

35,710 views • 3 years ago

📢MoRight: Motion Control Done Right "What if your video model actually understood cause and effect?" Existing motion-controlled video models entangle camera and object motion, and treat everything as kinematic displacement. MoRight changes both. 🔥 Motion Causality — MoRight decomposes motion into actions & consequences. Give an action → MoRight predicts consequences (aka motion simulation) . Give a desired outcome → MoRight recovers the driving action (aka motion planning). Not merely displacing pixels. 🎬 Disentangled Control — MoRight separates camera and object motion, allowing users to independently control each of them. No entanglement. Project Page: Paper:

📢MoRight: Motion Control Done Right "What if your video model actually understood cause and effect?" Existing motion-controlled video models entangle camera and object motion, and treat everything as kinematic displacement. MoRight changes both. 🔥 Motion Causality — MoRight decomposes motion into actions & consequences. Give an action → MoRight predicts consequences (aka motion simulation) . Give a desired outcome → MoRight recovers the driving action (aka motion planning). Not merely displacing pixels. 🎬 Disentangled Control — MoRight separates camera and object motion, allowing users to independently control each of them. No entanglement. Project Page: Paper:

Shaowei Liu

31,371 views • 1 month ago

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Bilawal Sidhu

27,074 views • 1 year ago

3D AI is getting crazier.. you now can transform character from real life video to 3D model with motion and.. it can also capture the expressions link in comment.

3D AI is getting crazier.. you now can transform character from real life video to 3D model with motion and.. it can also capture the expressions link in comment.

el.cine

181,371 views • 1 year ago

Direct3D‑S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention

Direct3D‑S2: Gigascale 3D Generation Made Easy with Spatial Sparse Attention

Dreaming Tulpa 🥓👑

27,799 views • 1 year ago

Meta releases VGGSfM Visual Geometry Grounded Deep Structure From Motion Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep SfM pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.

Meta releases VGGSfM Visual Geometry Grounded Deep Structure From Motion Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep SfM pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.

AK

95,553 views • 1 year ago

highlight from tonight's VRChat Avatar stream ^w^ (yes this is a feature) #3D #Pokemon

SpeedBuiz 🍂Autumn Orange Idiot🍊

11,048 views • 1 year ago