🚨 Someone just built a fully open-source mocap system that works with any camera. It's called FreeMoCap, a markerless 3D tracking system that runs on ordinary webcams. It turns multiple camera feeds into research-grade skeletal data automatically. 100% Open Source.

Repo: If you want more practical AI gems and use cases, join our free newsletter with daily tutorials and latest news in AI:

Webcams turning into full mocap rigs with zero markers is the kind of open-source win you don't see coming.

Also works kind of with only one camera. Of cause that not really a huge advantage than using OpenPose in ComfyUI

webcams really refuse to stay in their assigned class

this is huge for VTubers!

Starting post with "someone just built..." might get you blocked fast. Credit and link original source/author.

Can someone mod it to analyze a golf swing? 😅🏌️‍♂️

Motion capture used to cost $100K in equipment. Now it's a webcam and an open-source repo

Does it work with unreal engine?

open source mocap is a bold claim, but research-grade data from webcams feels like a stretch without seeing the error margins

Just? First commit was in July of 2022.

open source is great but research-grade from a webcam feels like a stretch i'll believe it when i see the jittery skeleton data

Something like this for face tracking in real time please ?

@simplifyinAI that's wild! can't wait to see how this could impact indie game dev. the barrier for entry just dropped big time.

Great 👍

this is the kind of open source magic that makes proprietary mocap suits sweat, just needs a few webcams and some python chaos

Mocap used to be a $10k/day studio rental. Now it's a webcam and a GitHub repo. The indie game/animation studios that figure this out first are going to punch way above their weight class. Same quality ceiling, 1/100th the budget.

Web3 AI models so huge already long time

@grok what’s this?

Is the Demo the result of 6 cameras? Is there anything available with a single or 2 camera set up?

@simplifyinAI how many cameras required ?

Epic!

free. u mean free. 😮

@grok what can you say about this?

Now that we have FreeMoCap making motion capture more accessible, I wonder what kind of creative projects will emerge from the intersection of open-source mocap and machine learning frameworks like TensorFlow or PyTorch.

markerless mocap from ordinary webcams producing research-grade data. professional motion capture rigs cost $50k+. this running on any camera is the kind of democratization that actually matters.

Democratizing markerless mocap via ordinary cameras supercharges the training data pipeline for generative video models. The unexpected edge: real-world skeletal data now flows at consumer scale, collapsing the gap between simulation and embodied robotics.

Motion capture just went from studio to laptop

100% Open Source is where the signal is. What would you test next if you were starting from zero?

SOMEONE GET THIS WORKING WITH VR CHAT RIGHT THE FUCK NOW

Excellent post. We can see many good things coming from this tech.

That's the same shape as LLM's 2D "Attractor", if it even qualifies as one.

Plot twist: you save the princess but then she’s a dude Wyd?

FreeMoCap running on webcams is a big step; share the latency numbers once people drop five streams on a cheap laptop so we know the pipeline holds.