Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

SpatialTrackerV2: unified, end-to-end 3D point tracking model which simultaneously estimates Camera Motion, Consistent Geometry and Pixel-wise 3D Trajectories.

bilawalsidhu's profile picture

Bilawal Sidhu

103,911 subscribers

20,346 görüntüleme • 11 ay önce •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

4 Yorum

Bilawal Sidhu profil fotoğrafı
Bilawal Sidhu11 ay önce

New ICCV paper. Here's a HuggingFace demo you can try today, as well as code for the offline tracker. Full paper and code release forthcoming.

Prashant profil fotoğrafı
Prashant11 ay önce

spatial ai is so important for building the digiverse

Himanshu Kumar profil fotoğrafı
Himanshu Kumar11 ay önce

Impressive, but true spatial awareness needs object permanence, not just point tracking.

Zoe Ai collab manager profil fotoğrafı
Zoe Ai collab manager11 ay önce

Dm

Benzer Videolar

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4
0:29

Introducing FLARE #CVPR2026 2025 FLARE is a feed-forward model that simultaneously estimates high-quality camera poses, 3D geometry, and appearance from sparse uncalibrated images. 1/4

Gordon Wetzstein

29,518 görüntüleme • 1 yıl önce

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs
0:20

We present VLM-3R: a Vision-Language Model capable of 3D spatial reasoning from monocular video, grounding visual cues, geometry, and camera motion. ✅ No depth sensor ✅ No pre-built 3D maps ✅ End-to-end spatial + temporal reasoning 🔗 Code & benchmark: #VLM #3DVision #LLMs

Zhiwen(Aaron) Fan

14,895 görüntüleme • 1 yıl önce

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.
0:38

"YoNoSplat: You Only Need One Model for Feedforward 3D Gaussian Splatting" TL;DR: a unified 3D Gaussian splatting model that reconstructs high-quality scene geometry and camera poses from unposed/uncalibrated images in a single forward pass.

Alexandre Morgand

14,839 görüntüleme • 3 ay önce

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.
0:24

RTFM can be seen as a learned renderer: it is an autoregressive diffusion transformer trained end-to-end on large-scale video data, and it learns to model 3D geometry, reflections, shadows and more just by observing them in its training set.

World Labs

15,870 görüntüleme • 8 ay önce

i bought a iphone just to add tracking to my model 💀 2d live pixel texture face on a 3d body made in the #GodotEngine
0:40

i bought a iphone just to add tracking to my model 💀 2d live pixel texture face on a 3d body made in the #GodotEngine

byte 🕹️ nme64 | DEBUT: TBA

50,954 görüntüleme • 2 yıl önce

Crazy 3D Model VTuber Tracking 🥴
0:21

Crazy 3D Model VTuber Tracking 🥴

Auteru🐣🌟

12,702 görüntüleme • 1 yıl önce

Created #GameChanger 3D Motion Teaser !! Do Watch Till the End 🫶♥️ !!
0:47

Created #GameChanger 3D Motion Teaser !! Do Watch Till the End 🫶♥️ !!

சிறுத்தை

109,236 görüntüleme • 1 yıl önce

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.
5:00

Christian Rupprecht explains their interpretability research in 3D computer vision, testing if (and where in the model) multi-view transformers like VGGT, DepthAnything 3, and DUSt3R use point/patch correspondences to make sense of 3D scene geometry.

Chris Offner

74,121 görüntüleme • 2 ay önce

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control
0:44

Love these old meets new vfx workflows 1. extract a still of the object you want to augment 2. use image-to-3d to make a 3d model of the object 3. use that 3d geometry for classical object tracking Then you can go wild with complete control

Bilawal Sidhu

33,824 görüntüleme • 1 yıl önce

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion
2:10

Champ Controllable and Consistent Human Image Animation with 3D Parametric Guidance In this study, we introduce a methodology for human image animation by leveraging a 3D human parametric model within a latent diffusion framework to enhance shape alignment and motion

AK

194,356 görüntüleme • 2 yıl önce

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding
0:30

3D-R1 is out on Hugging Face Enhancing Reasoning in 3D VLMs for Unified Scene Understanding 3D-R1 is an open-source generalist model that enhances the reasoning of 3D VLMs for unified scene understanding

AK

34,729 görüntüleme • 10 ay önce

byebye expensive motion tracking equipment 👋 ai makes motion capturing so easy now! nvidia presented GENMO last week, a new model that can generate and estimate human motion from text, audio, video, and 3D keyframes
0:26

byebye expensive motion tracking equipment 👋 ai makes motion capturing so easy now! nvidia presented GENMO last week, a new model that can generate and estimate human motion from text, audio, video, and 3D keyframes

Dreaming Tulpa 🥓👑

73,693 görüntüleme • 1 yıl önce

🪬 #Live3D #Live2D #Live2DWIP 🪬 Testing finger articulation... Left: randomized auto motion Right: real-time camera tracking I wonder how many Vtubers would consider adding this kind of pseudo-3D hand to their Live2D model 🧐?
0:59

🪬 #Live3D #Live2D #Live2DWIP 🪬 Testing finger articulation... Left: randomized auto motion Right: real-time camera tracking I wonder how many Vtubers would consider adding this kind of pseudo-3D hand to their Live2D model 🧐?

📐Hephaestus📏Live2D匠人魂

36,222 görüntüleme • 4 ay önce

Most generative models predict pixels. Predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. The simplest way to visualize the 3D scene is a depth map, where each pixel is colored by its distance to the camera. 4/n
0:20

Most generative models predict pixels. Predicting a 3D scene instead has many benefits: the scene won’t change if you look away and come back, and it obeys the basic physical rules of 3D geometry. The simplest way to visualize the 3D scene is a depth map, where each pixel is colored by its distance to the camera. 4/n

World Labs

16,605 görüntüleme • 1 yıl önce

🚨 Pixal3D is now live on fal! 🧊 High-fidelity 3D assets from a single image 🎯 Pixel-aligned back-projection for direct pixel-to-3D correspondence 🎨 Detailed geometry with PBR textures, ready for downstream pipelines
0:38

🚨 Pixal3D is now live on fal! 🧊 High-fidelity 3D assets from a single image 🎯 Pixel-aligned back-projection for direct pixel-to-3D correspondence 🎨 Detailed geometry with PBR textures, ready for downstream pipelines

fal

14,192 görüntüleme • 1 ay önce

Introducing Texel Splatting: Perspective-Stable 3D Pixel Art open source paper+code Most 3D pixel art techniques (e.g. t3ssel8r, ProPixelizer) snap pixels to a screen grid, which only works with an orthographic camera Texel splatting solves this for perspective cameras: first,
1:12

Introducing Texel Splatting: Perspective-Stable 3D Pixel Art open source paper+code Most 3D pixel art techniques (e.g. t3ssel8r, ProPixelizer) snap pixels to a screen grid, which only works with an orthographic camera Texel splatting solves this for perspective cameras: first,

dylan

111,285 görüntüleme • 3 ay önce

Supervised learning has held 3D Vision back for too long. Meet RayZer — a self-supervised 3D model trained with zero 3D labels: ❌ No supervision of camera & geometry ✅ Just RGB images And the wild part? RayZer outperforms supervised methods (as 3D labels from COLMAP is noisy) 🌐 Project: (1/4)
0:27

Supervised learning has held 3D Vision back for too long. Meet RayZer — a self-supervised 3D model trained with zero 3D labels: ❌ No supervision of camera & geometry ✅ Just RGB images And the wild part? RayZer outperforms supervised methods (as 3D labels from COLMAP is noisy) 🌐 Project: (1/4)

Hanwen Jiang

69,527 görüntüleme • 1 yıl önce

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway
0:29

3D controllable video generation works well now and pixel alignment is impressive! We took our new 3D sculpt model, generated a blender scene and then asked a video-to-video model to render. Image to 3D sculpt: Common Sense Machines Synthetic rendering: Blender 🔶 Video-to-Video: Runway

Common Sense Machines

18,714 görüntüleme • 1 yıl önce