Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

expanding on my WebGPU motion tracking effect work this time with optical flow to visualize the motion of pixels as directional vectors in real time :)

Maxime

14,316 subscribers

19,931 views • 1 month ago •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

blob tracking effect built with WebGPU had fun playing with motion-based effects alongside sound over the past few weeks :)

blob tracking effect built with WebGPU had fun playing with motion-based effects alongside sound over the past few weeks :)

Maxime

19,472 views • 1 month ago

Netflix just dropped Go-with-the-Flow Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise

Netflix just dropped Go-with-the-Flow Motion-Controllable Video Diffusion Models Using Real-Time Warped Noise

AK

95,564 views • 1 year ago

Time to put those deformable voxels to work. Here is a very quick softbody test. There are some artefacts and missing motion vectors but there's potential!

Time to put those deformable voxels to work. Here is a very quick softbody test. There are some artefacts and missing motion vectors but there's potential!

Dennis Gustafsson

140,069 views • 2 years ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

28,871 views • 7 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

15,968 views • 6 months ago

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

UE5.6 AI Real-Time Motion Generation Plugin — powered by a 1-billion-parameter motion model trained on NVIDIA CUDA. It runs locally in real time with 8GB of VRAM and converts webcam or video footage into real-time XYZ skeletal point data and rotation values.

CYANPUPPETS

28,846 views • 6 months ago

I forgot to share this reel of my work I had to make for the Young Guns ceremony earlier this month—it was really fun to see some of my work in motion for the first time! (By "had to make" I obviously mean "had to hire someone to make"—huge ty to motion designer Devon Burgoyne!)

I forgot to share this reel of my work I had to make for the Young Guns ceremony earlier this month—it was really fun to see some of my work in motion for the first time! (By "had to make" I obviously mean "had to hire someone to make"—huge ty to motion designer Devon Burgoyne!)

Elizabeth Goodspeed

76,730 views • 1 year ago

Hooke's law in motion: a dancer's joints anchor a real-time spring-mass lattice. Every extension, contraction, and twist propagates tension through the system; rendering these hypnotic, radiating dashed vectors as emergent force fields.

Hooke's law in motion: a dancer's joints anchor a real-time spring-mass lattice. Every extension, contraction, and twist propagates tension through the system; rendering these hypnotic, radiating dashed vectors as emergent force fields.

Mathematica

1,580,914 views • 4 months ago

Tracking Everything Everywhere All at Once paper page: present a new test-time optimization method for estimating dense and long-range motion from a video sequence. Prior optical flow or particle video tracking algorithms typically operate within limited temporal windows, struggling to track through occlusions and maintain global consistency of estimated motion trajectories. We propose a complete and globally consistent motion representation, dubbed OmniMotion, that allows for accurate, full-length motion estimation of every pixel in a video. OmniMotion represents a video using a quasi-3D canonical volume and performs pixel-wise tracking via bijections between local and canonical space. This representation allows us to ensure global consistency, track through occlusions, and model any combination of camera and object motion. Extensive evaluations on the TAP-Vid benchmark and real-world footage show that our approach outperforms prior state-of-the-art methods by a large margin both quantitatively and qualitatively.

Tracking Everything Everywhere All at Once paper page: present a new test-time optimization method for estimating dense and long-range motion from a video sequence. Prior optical flow or particle video tracking algorithms typically operate within limited temporal windows, struggling to track through occlusions and maintain global consistency of estimated motion trajectories. We propose a complete and globally consistent motion representation, dubbed OmniMotion, that allows for accurate, full-length motion estimation of every pixel in a video. OmniMotion represents a video using a quasi-3D canonical volume and performs pixel-wise tracking via bijections between local and canonical space. This representation allows us to ensure global consistency, track through occlusions, and model any combination of camera and object motion. Extensive evaluations on the TAP-Vid benchmark and real-world footage show that our approach outperforms prior state-of-the-art methods by a large margin both quantitatively and qualitatively.

AK

280,547 views • 3 years ago

🚀 Introducing MegaFlow: Zero-Shot Large Displacement Optical Flow! 🔥 Code, models, and demo — all available now! 🎯 Large displacement motion estimation (optical flow, point tracking) has been a long-standing challenge. MegaFlow proposes a simple solution by leveraging pre-trained vision priors. Combined with a global matching formulation, we tackle both optical flow and point tracking in a unified structure, delivering incredibly strong results. 🏆 SOTA zero-shot performance across multiple benchmarks and in-the-wild videos. Check out the links below to see it in action! 👇

🚀 Introducing MegaFlow: Zero-Shot Large Displacement Optical Flow! 🔥 Code, models, and demo — all available now! 🎯 Large displacement motion estimation (optical flow, point tracking) has been a long-standing challenge. MegaFlow proposes a simple solution by leveraging pre-trained vision priors. Combined with a global matching formulation, we tackle both optical flow and point tracking in a unified structure, delivering incredibly strong results. 🏆 SOTA zero-shot performance across multiple benchmarks and in-the-wild videos. Check out the links below to see it in action! 👇

Haofei Xu

32,233 views • 4 months ago

In the past, AI motion capture was too unstable to form a reliable workflow. Now, with a 1-billion-parameter AI real-time motion model, you can connect a 1080P camera or upload videos to achieve highly stable, low-latency real-time capture. It supports UE, Unity, and Blender, and requires 8GB of VRAM for real-time processing.

In the past, AI motion capture was too unstable to form a reliable workflow. Now, with a 1-billion-parameter AI real-time motion model, you can connect a 1080P camera or upload videos to achieve highly stable, low-latency real-time capture. It supports UE, Unity, and Blender, and requires 8GB of VRAM for real-time processing.

CYANPUPPETS

18,703 views • 3 months ago

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

CYANPUPPETS

124,866 views • 7 months ago

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

CYANPUPPETS

18,317 views • 7 months ago

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

Blender AI Motion Plugin — a 1-billion-parameter motion model trained on NVIDIA CUDA, running locally in real time with 8GB of VRAM. It converts webcam or video footage into real-time XYZ skeletal point data and rotation values, transmitting them to Blender, Unity, and UE for retargeting.

CYANPUPPETS

32,379 views • 8 months ago

I got to remake Batman Returns as a stop motion animation for work! 🦇🐈🐧 This actually marks my first time animating the world of Batman on an official WB approved level. #stopmotion #animation #batmanreturns

I got to remake Batman Returns as a stop motion animation for work! 🦇🐈🐧 This actually marks my first time animating the world of Batman on an official WB approved level. #stopmotion #animation #batmanreturns

D.M. Galloway | DGDX Animation

13,418 views • 2 months ago

The free UE5.5 AI motion capture plugin is compatible with Unity, Blender, and VMC. It supports both real-time motion capture via webcam and video uploads to generate 3D motion data. Powered by a 1-billion-parameter motion model running locally on your computer, it requires 8GB of VRAM for real-time processing. Compatible with Nvidia, AMD, and Intel GPUs, it can leverage NVIDIA CUDA to significantly boost graphics computation efficiency.

The free UE5.5 AI motion capture plugin is compatible with Unity, Blender, and VMC. It supports both real-time motion capture via webcam and video uploads to generate 3D motion data. Powered by a 1-billion-parameter motion model running locally on your computer, it requires 8GB of VRAM for real-time processing. Compatible with Nvidia, AMD, and Intel GPUs, it can leverage NVIDIA CUDA to significantly boost graphics computation efficiency.

CYANPUPPETS

17,842 views • 1 year ago

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.

UE5.6 real-time motion capture plugin with native MetaHuman support. It requires only a webcam or uploaded video, and uses a 1-billion-parameter model to convert video into 3D motion data in real time, enabling automatic retargeting.

CYANPUPPETS

47,851 views • 4 months ago

Reps In Rowdy Session Over Motion To Rescind ‘Real-Time’ Clause In Electoral Act

Reps In Rowdy Session Over Motion To Rescind ‘Real-Time’ Clause In Electoral Act

Channels Television

40,242 views • 5 months ago

THE FIRST EVER AI motion design tool with full real-time control. Higgsfield Vibe-Motion is LIVE. Motion Design was never that easy. One prompt creates any motion design you can imagine. Refine every parameter live on canvas. No creative limits.

THE FIRST EVER AI motion design tool with full real-time control. Higgsfield Vibe-Motion is LIVE. Motion Design was never that easy. One prompt creates any motion design you can imagine. Refine every parameter live on canvas. No creative limits.

Higgsfield AI 🧩

3,146,498 views • 6 months ago

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking paper page: introduce PointOdyssey, a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. Our goal is to advance the state-of-the-art by placing emphasis on long videos with naturalistic motion. Toward the goal of naturalism, we animate deformable characters using real-world motion capture data, we build 3D scenes to match the motion capture environments, and we render camera viewpoints using trajectories mined via structure-from-motion on real videos. We create combinatorial diversity by randomizing character appearance, motion profiles, materials, lighting, 3D assets, and atmospheric effects. Our dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work. We show that existing methods can be trained from scratch in our dataset and outperform the published variants. Finally, we introduce modifications to the PIPs point tracking method, greatly widening its temporal receptive field, which improves its performance on PointOdyssey as well as on two real-world benchmarks.

AK

122,560 views • 3 years ago