Testing Sam3d body cpp on windows...

I've added on issue on the github repo with the source code updated, that I used to compile on windows. Here is the link ot it

waited for this 😭

This man from you GIF could join the woman from the test footage for a dance 😀

did you have to separately install your own model or was it included in the EXE? also, btw, i want that but for a mediapipe-based facial mocap solution that can track even hard-to-see face angles, and output ARKIT blendshapes :-)

It was not an exe, I had to compile it from scratch 😅 the githuv gives a link with the molde in onnx format. About the face mocap solution.... I spent a lot of time searching that... I gave up. 😅

Yes, I have given up many times too LOL. I think the 'solution' might end up being to use one of the "frontalization" techniques out there, to create a stabliized front-facing closeup (even from raw material that is turning heads etc). But yeah I have no idea lol. KeenTools have their FaceTracker which gets somewhat towards a solution but isn't automatic.

Oh and when I tested keentools just to get the head shape, it wasn't as good as i expected. So I think that for facemocap it will be not as good as I would like too. So let me bring and idea. Have looked on the solution used for the game LA Noir? Maybe that solution could be good for what youd like to have.

No I’m not familiar with that. I’ll check it out

this is how the clanks look at us

Who are these clanks? I dont want then looking at me 😬

i think they're about to be everywhere very soon

build type matters, windows cmake projects default to debug so your perf might be way off until you switch to release mode

Thanks for the tip 💪 Gotta say, most of the work was done by Gemini, I still gotta check what it has done, but, what was compiled was saved on a Release folder, so I think this video is recorded already on release mode, but I'll check to be sure.

is it a mocap tool or something else?

Sam 3d body cpp is a faster implementation of same 3d body, from meta. Im using it for an add-on to get mocap from monocular video. Im calling it CEB Sam3d body (so people know right from the start what is the backbone of the addon)

I get it - but can it export fbx files with solid, non drifting foot contacts? :)

No. What I'm trying to do is to make the final result better, that can move considering also the camera motion. You'd need to edit the animation in order to have a solid, non drifting foot contact.

Can it handle special cases like this?

This is the raw result, using sam 3d body cpp + droidslam

I would say it did better than I expected. It appears it started to slide around only after camera pan started to go too fast.

Yeah, I fell that the speed is higher than what it should. I'm been testing all 3 method of SAM 3d body, and at least on my addon, they have significant differences on the translation. these 3 charaters that doest go forward are the default output from: Green: Standard SAM 3d Blue: Fast SAM 3d Red: SAM3d CPP Its possible that I messed up something in the code, I just finished integrating all of the in the addon.

I think the red one is closest to reality in this clip. It's still moving too rapidly forward but the overall stability is better than blue or green.

Yeah, and yet that is soo strange, in theory, the best one should be the green. the worst one should be the red. Gotta test more.

What gpu are you using?

RTX3090

Interesting, I have a 3070 with 8g vram and last time I tried running sam3 kept running out of memory

Just did the test. Beforestarting the test, my gpu was already using 3gb of VRAM, when I started the process, it went to 7gb. So I think its using 7-3 = 4gb of VRAM. you said you have 8gb, so it worth a try. the video of the test is attached. I also shared the updated code that I used to compile here.

Damn, I’ve been waiting for this thanks for taking the time to check 🙏🏽