Motion matching, running in the browser. WebGPU + Rust/WASM in my toy renderer. Every frame searches a pose database for the clip that best matches the stick + predicted trajectory, inertialized blends, foot locking, and parkour with motion warping.

The character was obviously created with NB2 and converted to a mesh with Hi3D (Sparc3D) then rigged to match UEFN mannequin with Opus 5.5 and Blender MCP. What a time to be alive.

more action :)

This looks so good. I attempted something similar recently and got decent but not great results. What pose DB are you using?

Awesome! my implementation is using for now a local custom binary version of the Unreal GASP animation lib. I heard about ML solutions to this, would be nice to investigate them, as Epic licensing may be a blocker to publish outside UE

Does this scale to crowds? Asking for a few hundred soldiers on a wall

I didnt tried it, but the query takes around 90~150µs on wasm, that may be ok for dozens. For hundreds we may need to move the processing to the gpu.

Thanks for the numbers. Here's the wall in question, soldiers still falling like planks:

Siiick! How many MB is the data in total? 👀

This one is 25mb 😅

Ohhh not bad!

mom: dont be scared, parkour andy burnham isnt real parkour andy burnham:

This looks super clean. Dang, people are making really cool stuff right now! Everyday I see things I didn't even know were possible. You guys make it so hard to stay focused on my own projects.

yeah, I feel you..

Very cool stuff

thanks jay

This looks so smooth!

Thanks! It is quite smooth yeah

holy shit! that's good 😍

Thanks!! Looking solid yeah!

Motion matching is wild 🔥

indeed :)

@Sirokos Nice quite new to the coding world but I wonder if a browser based tool like Unity/blender is possible. I am learning HTML CSS hoping to learn python then either rust or C++ I read both languages are very big in 3d Ai/ml and cyber no idea what to go for?

unity/blender are native solutions, meaning they have access to a wider (more modern) set of api's for graphics and performance intensive cpu processing, that said, the web is quite capable and you can get things done at a different scale. On the language/coding question... unsure what to recommend at this point. if your goal is to learn hand coding, then yeah start simple and get more complex later.

Motion matching with inertialized blends and foot locking in a tab is no joke. The parkour warping bit is what usually falls apart first in WASM.

I've been getting a ton of Github notifications from this repo - super excited to see what you've been up to! Have you pushed the examples live?

I need to triple check because the poses DB may be restricted to be used only with UE, it’s a bit unclear, but there are alternatives. Will try to get something published at some point.

@tomorrowevening I did exactly the same as you, as soon as the license changed I forked in rust the gasp and entire mm db from ue5 to my own engine, I took screenshots and saved the actual license in case of it change again later. You are only not allowed to give this bank away

@tomorrowevening exactly, I created a custom binay file including the DB from GASP and this is what my web demo consumes, but I need clearance if its ok to publish it, as that may make the "binarized" db available from my host. A bit confusing to navigate these legal stuff..

@tomorrowevening I think posting it in a public repo might be a problem

@tomorrowevening Yeah, but also publishing it as part of a website, because anyone could check network and download it straight from the webhosting. I’m unsure on what’s acceptable from the license text.

Wow !

😅

Is this a port of ue gasp? :)

not really a port, but a new implementation based on the papers. And yes, it uses the pose DB from ue gasp

Oh BTW, do you know or can point me to the right person to clarify if it's OK to use the sample's locomotion and traversal clips from GASP on a web implementation? The standard Fab license seems to be more permissive than the old Epic one. I guess Fab support is the place to ask

Really cool 🔥

Thanks Mathis 🫰

Claude port the game animation sample to browser….

not exactly, but exactly.

lol

Really cool but you still have a lot of foot sliding

This is awesome! Do you have any plans to try latest generative model research (eg. ) instead of using a pose database lookup? I’d be interested in contributing to open source for web package with you

that's interesting. A bit unsure on the quality of the animations tho.. but definitely something cool to explore.

Brutal 🤩!

yes!

awesome !

Appreciated :)

Looking good - open source?

the implementation its on my repo, the mocap animations library its excluded for now until clearance from epic.

well this is incredible.