Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

bilawalsidhu's profile picture

Bilawal Sidhu

103,911 subscribers

20,346 Aufrufe • vor 11 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

4 Kommentare

Profilbild von Bilawal Sidhu
Bilawal Sidhuvor 11 Monaten

New ICCV paper. Here's a HuggingFace demo you can try today, as well as code for the offline tracker. Full paper and code release forthcoming.

Profilbild von Prashant
Prashantvor 11 Monaten

spatial ai is so important for building the digiverse

Profilbild von Himanshu Kumar
Himanshu Kumarvor 11 Monaten

Impressive, but true spatial awareness needs object permanence, not just point tracking.

Profilbild von Zoe Ai collab manager
Zoe Ai collab managervor 11 Monaten

Dm

Ähnliche Videos

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4
0:29

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4

Gordon Wetzstein

29,518 Aufrufe • vor 1 Jahr

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs
0:20

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs

Zhiwen(Aaron) Fan

14,895 Aufrufe • vor 1 Jahr

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.
0:38

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

14,839 Aufrufe • vor 3 Monaten

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.
0:24

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 Aufrufe • vor 8 Monaten

i bought a iphone just to add tracking to my model 💀 2d live pixel texture face on a 3d body made in the #GodotEngine
0:40

i bought a iphone just to add tracking to my model 💀 2d live pixel texture face on a 3d body made in the #GodotEngine

byte 🕹️ nme64 | DEBUT: TBA

50,954 Aufrufe • vor 2 Jahren

Crazy 3D Model VTuber Tracking 🥴
0:21

Crazy 3D Model VTuber Tracking 🥴

Auteru🐣🌟

12,702 Aufrufe • vor 1 Jahr

Created #GameChanger 3D Motion Teaser !! Do Watch Till the End 🫶♥️ !!
0:47

Created #GameChanger 3D Motion Teaser !! Do Watch Till the End 🫶♥️ !!

சிறுத்தை

109,236 Aufrufe • vor 1 Jahr

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.
5:00

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.

Chris Offner

74,121 Aufrufe • vor 2 Monaten

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control
0:44

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Bilawal Sidhu

33,824 Aufrufe • vor 1 Jahr

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion
2:10

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion

AK

194,356 Aufrufe • vor 2 Jahren

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 Aufrufe • vor 10 Monaten

byebye expensive motion tracking equipment 👋 ai makes motion capturing so easy now! nvidia presented GENMO last week, a new model that can generate and estimate human motion from text, audio, video, and 3D keyframes
0:26

byebye expensive motion tracking equipment 👋 ai makes motion capturing so easy now! nvidia presented GENMO last week, a new model that can generate and estimate human motion from text, audio, video, and 3D keyframes

Dreaming Tulpa 🥓👑

73,693 Aufrufe • vor 1 Jahr

Most generative models predict pixels. Predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. The simplest way to visualize the 3D scene is a depth map, where each pixel is colored by its distance to the camera. 4/n
0:20

Most generative models predict pixels. Predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. The simplest way to visualize the 3D scene is a depth map, where each pixel is colored by its distance to the camera. 4/n

World Labs

16,605 Aufrufe • vor 1 Jahr

🪬 #Live3D #Live2D #Live2DWIP 🪬 Testing finger articulation... Left: randomized auto motion Right: real-time camera tracking I wonder how many Vtubers would consider adding this kind of pseudo-3D hand to their Live2D model 🧐?
0:59

🪬 #Live3D #Live2D #Live2DWIP 🪬 Testing finger articulation... Left: randomized auto motion Right: real-time camera tracking I wonder how many Vtubers would consider adding this kind of pseudo-3D hand to their Live2D model 🧐?

📐Hephaestus📏Live2D匠人魂

36,222 Aufrufe • vor 4 Monaten

🚨 Pixal3D is now live on fal! 🧊 High-fidelity 3D assets from a single image 🎯 Pixel-aligned back-projection for direct pixel-to-3D correspondence 🎨 Detailed geometry with PBR textures, ready for downstream pipelines
0:38

🚨 Pixal3D is now live on fal! 🧊 High-fidelity 3D assets from a single image 🎯 Pixel-aligned back-projection for direct pixel-to-3D correspondence 🎨 Detailed geometry with PBR textures, ready for downstream pipelines

fal

14,192 Aufrufe • vor 1 Monat

Introducing Texel Splatting: Perspective-Stable 3D Pixel Art open source paper+code Most 3D pixel art techniques (e.g. t3ssel8r, ProPixelizer) snap pixels to a screen grid, which only works with an orthographic camera Texel splatting solves this for perspective cameras: first,
1:12

Introducing Texel Splatting: Perspective-Stable 3D Pixel Art open source paper+code Most 3D pixel art techniques (e.g. t3ssel8r, ProPixelizer) snap pixels to a screen grid, which only works with an orthographic camera Texel splatting solves this for perspective cameras: first,

dylan

111,285 Aufrufe • vor 2 Monaten

Supervised learning has held 3D Vision back for too long. Meet RayZer — a self-supervised 3D model trained with zero 3D labels: ❌ No supervision of camera & geometry ✅ Just RGB images And the wild part? RayZer outperforms supervised methods (as 3D labels from COLMAP is noisy) 🌐 Project: (1/4)
0:27

Supervised learning has held 3D Vision back for too long. Meet RayZer — a self-supervised 3D model trained with zero 3D labels: ❌ No supervision of camera & geometry ✅ Just RGB images And the wild part? RayZer outperforms supervised methods (as 3D labels from COLMAP is noisy) 🌐 Project: (1/4)

Hanwen Jiang

69,460 Aufrufe • vor 1 Jahr

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway
0:29

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 Aufrufe • vor 1 Jahr