I've put sam3d.cpp up on GitHub! Currently have sam3d-body working that tracks body movements and recreates an unflattering body mesh.

Presently I only have 60% GPU util, so there is room left for improvement on live tracking.

I've been working on a non-model way of doing this. Your results seem more accurate but slower to update the skeleton. I added face tracking as well. My end game is trying to figure out how to combine all the various techniques and get 60 fps.

What's that using? Is it 3d or 2d?

It's a custom engine in rust. All software on the CPU. I haven't thrown Astro at it yet. It's mostly a mix of GPT 5.6 and Claude. I grabbed like 70 papers on motion capture and put them in a folder and had agents keep iterating. It edits a VRChat skeleton avatar

Love it. 👏Finally working in the browser. 🦾 I run this on iOS without any models. But sadly only possible in iOS. Needs more love with 3D model and rigging buts it’s working.

Can you create animations based on this ?

Yes, just need an exporter

Looks good. Can I use this data in blender? Transfer to mesh of my choice?

Not yet, but shouldn't be too hard to export it to whatever data format (glb?)

Is it realtime? What framerate are you getting / what gpu