I put motion-bricks.cpp up on GitHub! It generates animations from key-frames in realtime using a tiny model that easily runs on a desktop CPU and Vulkan. There are still bugs to iron out and I'm thinking this can be combined with physical simulation and robotic control policies...

Also checkout my livestreams on this:

They look very similar; is there a connection between them?

Yes that's the original in PyTorch

I'm curious how this will be used in games, like I still don't understand how people chain different animations and make them fluid like we can see in Arc Raiders. Weighted and grounded movements.

I have no idea how current games do it, but this is designed to be used with robots that are constrained by physics and have a control policy (another neural net that is trained with RL to keep the robot upright) that will attempt to stabalise the robot while MotionBricks provides movement targets. So in a game you could physically simulate a character with a control policy to balance them, then use motion bricks to generate target movements. At the end you only get physically possible movements

That’s really interesting because motion bricks and kimodo are pretty similar, except one is text to motion. OwO

Awesome for animators and game creators

Cool thanks, I'll take a look, I'm working on a pipeline where I want to generate poses with openai Imagine2 and I extract keypoints with mediapipe or similar and map to a skeleton to have the pose I can place on a 3d canvas, this may be the way

Nice!

Please attach the head to it.😱

It's the skeleton for the Unitree G1 which has a head but I guess it's static

Got it, it's great.

Pretty badass dude. Cool beans!

Seems like Cascadeur!

Bro how are u achiving it its going beyond my head

Runs on CPU, that's wild

Looks impressive! BTW if you are intetested in neural character animation check out the "Control Operators for Interactive Character Animation" and "Learned Motion Matching"

@taksasDESUYO い

wtf that's so cool, how close is this to the pareto-frontier? or is it just an experiment?

might play with this in my game engine / project

两个人互动可以做吗？

I'm not sure that translates correctly, but probably the answer is no

@NickChapmn when in @SubstrataVr ?

Hey dude:)) this is amazing, can u send me dm? i can´t

looks cool! thanx for sharing!

Nice work! I had the same idea what are your future plans? I'm still trying to learn more about motion bricks. uncharted territory :D