Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

SpatialTracker Tracking Any 2D Pixels in 3D Space Recovering dense and long-range pixel motion in videos is a challenging problem. Part of the difficulty arises from the 3D-to-2D projection process, leading to occlusions and discontinuities in the 2D motion domain.

AK

460,253 subscribers

77,162 views • 2 years ago •via X (Twitter)

Science & Technology Education

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Is your game 2D or 3D? Yes and also in pixel mode

Is your game 2D or 3D? Yes and also in pixel mode

Dark Light

31,860 views • 1 year ago

CG Hitchhiker shared Part 2 of their “2D look, 3D rig” tests, pushing a stretchy cartoon style with clever rig tricks to keep that flat, 2D feel in motion 🎬 See more:

CG Hitchhiker shared Part 2 of their “2D look, 3D rig” tests, pushing a stretchy cartoon style with clever rig tricks to keep that flat, 2D feel in motion 🎬 See more:

Jettelly Inc.

36,383 views • 5 months ago

I've figured out how to constantly switch between 2D and 3D in order my gaslight the chat. I can start out as a 2D model then zoom out to reveal we were in 3D the whole time.

I've figured out how to constantly switch between 2D and 3D in order my gaslight the chat. I can start out as a 2D model then zoom out to reveal we were in 3D the whole time.

shindigs

54,090 views • 1 year ago

fromCompToSurface() makes it easy to convert 2D effects into 3D space in After Effects without all the math.

fromCompToSurface() makes it easy to convert 2D effects into 3D space in After Effects without all the math.

François Lefebvre

12,956 views • 2 months ago

Roundhouse kicks feel so weird in 2d and 3d at the same time

Roundhouse kicks feel so weird in 2d and 3d at the same time

Screenbound - A game about being distracted

24,957 views • 2 years ago

More PixiJS 3D testing 👀 Take any live 2D PixiJS content (sprites, text, graphics) and render it onto 3D geometry Our goal is to make working between 2D and 3D as seamless as possible in our WebGPU/WebGL renderer Let us know what features you'd like to see!

More PixiJS 3D testing 👀 Take any live 2D PixiJS content (sprites, text, graphics) and render it onto 3D geometry Our goal is to make working between 2D and 3D as seamless as possible in our WebGPU/WebGL renderer Let us know what features you'd like to see!

PixiJS

30,996 views • 1 month ago

This is excellent, Victor Verdugo! 😍 Victor V. created this #Houdini exploration to depict the "waste we leave." He used Cloth and ShapeMatch constraints from Vellum. Victor is a 3D Motion designer who either animates 2D designs or creates 3D pieces from scratch.

This is excellent, Victor Verdugo! 😍 Victor V. created this #Houdini exploration to depict the "waste we leave." He used Cloth and ShapeMatch constraints from Vellum. Victor is a 3D Motion designer who either animates 2D designs or creates 3D pieces from scratch.

Houdini.School

12,920 views • 1 year ago

3D to 2D, The camera is a beautiful liar. #3DAnime #IndieAnime #Rig

3D to 2D, The camera is a beautiful liar. #3DAnime #IndieAnime #Rig

Okawaii

130,254 views • 2 months ago

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Monocular pose estimation has gotten really good Grab any 2D video and transfer the performance to a 3D character

Bilawal Sidhu

27,074 views • 1 year ago

This looks 2D... but it's 3D 🤯This 2D animation technique in Blender is absolutely BRILLIANT! ✨ Yana Zavialova (CG Hitchhiker) creating old-school 2D-looking animation with 3D rigged models? That's the perfect hybrid workflow! 🔥

This looks 2D... but it's 3D 🤯This 2D animation technique in Blender is absolutely BRILLIANT! ✨ Yana Zavialova (CG Hitchhiker) creating old-school 2D-looking animation with 3D rigged models? That's the perfect hybrid workflow! 🔥

3DxDEV

13,465 views • 5 months ago

Meta releases VGGSfM Visual Geometry Grounded Deep Structure From Motion Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep SfM pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.

Meta releases VGGSfM Visual Geometry Grounded Deep Structure From Motion Structure-from-motion (SfM) is a long-standing problem in the computer vision community, which aims to reconstruct the camera poses and 3D structure of a scene from a set of unconstrained 2D images. Classical frameworks solve this problem in an incremental manner by detecting and matching keypoints, registering images, triangulating 3D points, and conducting bundle adjustment. Recent research efforts have predominantly revolved around harnessing the power of deep learning techniques to enhance specific elements (e.g., keypoint matching), but are still based on the original, non-differentiable pipeline. Instead, we propose a new deep SfM pipeline VGGSfM, where each component is fully differentiable and thus can be trained in an end-to-end manner. To this end, we introduce new mechanisms and simplifications. First, we build on recent advances in deep 2D point tracking to extract reliable pixel-accurate tracks, which eliminates the need for chaining pairwise matches. Furthermore, we recover all cameras simultaneously based on the image and track features instead of gradually registering cameras. Finally, we optimise the cameras and triangulate 3D points via a differentiable bundle adjustment layer. We attain state-of-the-art performance on three popular datasets, CO3D, IMC Phototourism, and ETH3D.

AK

96,527 views • 2 years ago

This is 3D animation powered by AI. No suits or markers needed. This 2D video was captured with GoPro cameras and converted to 3D motion data using Move Multi-Cam. #MadeWithMove

This is 3D animation powered by AI. No suits or markers needed. This 2D video was captured with GoPro cameras and converted to 3D motion data using Move Multi-Cam. #MadeWithMove

Move AI

182,792 views • 2 years ago

Hop between clever 2D and 3D worlds in The Plucky Squire, available with the PlayStation Plus Game Catalog

Hop between clever 2D and 3D worlds in The Plucky Squire, available with the PlayStation Plus Game Catalog

PlayStation

476,656 views • 1 year ago

Kevin Temmer, the Lead Animator in the series The Amazing Digital Circus, shared a behind-the-scenes look at the creative process and showed how he made a 2D-style animation in 3D software. Check out:

Kevin Temmer, the Lead Animator in the series The Amazing Digital Circus, shared a behind-the-scenes look at the creative process and showed how he made a 2D-style animation in 3D software. Check out:

80 LEVEL

40,943 views • 10 months ago

2D & 3D NFT Reveal in 20 minutes 👑 Connect to the official website to reveal your NFT! 👉

2D & 3D NFT Reveal in 20 minutes 👑 Connect to the official website to reveal your NFT! 👉

Orivium

63,500 views • 2 years ago

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.

YOU CAN NOW REMASTER ANY 2D GAME INTO A 3D WORLD Pokémon Ruby defined a generation of top-down handheld gaming. 2D is fast and solo-friendly: tiles, sprites, simple animations. 3D has always been brutal modeling, rigging, lighting, LODs, and months of specialized work that kills most small teams. Mint shatters that One screenshot → instant coherent 3D worlds No more waiting for studios to invest a 2D game becomes 3D today.

mint

16,515 views • 1 month ago

was working on a small thingy of my own but i really don't think i'd make anything of it, especially anytime soon. it's like an open world game, played in both 2d and 3d, where you can switch from 2d people to 3d people and help each other out

was working on a small thingy of my own but i really don't think i'd make anything of it, especially anytime soon. it's like an open world game, played in both 2d and 3d, where you can switch from 2d people to 3d people and help each other out

Cassy

53,620 views • 1 year ago