Loading video...

Video Failed to Load

Go Home

These are not Mixamo animations. These are neurally motion-matched animations from 9 x H3 Max ( fal ) videos (8 x image-to-video, 1 x extend-video) Result in video one, references in video two All bundled together in a Three.js WebGPU playground with custom IK & blending

15,424 views • 7 days ago •via X (Twitter)

12 Comments

Matt's profile picture
Matt7 days ago

This is within 3 prompts (4 if you include me asking for Aces & SSGI) - from videos to demo The parkour one I had Opus 5.5 extract 3 clips which you'll see in the demo: vault up, jump gap & fall Everything is procedurally modified so longer jumps, though naive, look normal

Matt's profile picture
Matt7 days ago

A demo link will drop this week. It needs other animation states & to feel more fluid because jumping up on ledges / between locks you on approach. Free open source parkour player controller! I think Mixamo Y-bot is open source? If not I'll have to generate a Tripo character.

Slopa's profile picture
Slopa7 days ago

@fal @threejs oh my god this probably will be the next big thing i'll study for my game. thank you for sharing!

Matt's profile picture
Matt7 days ago

@fal @threejs You’re most welcome. GHVMR is the best model by a country mile. Grab the SMPL-X rig (after accepting terms) and you’re off to the races

DeGen Rivals BETA OUT NOW! 💥's profile picture
DeGen Rivals BETA OUT NOW! 💥6 days ago

@fal @threejs Super cool!

Emmett Lawlor's profile picture
Emmett Lawlor6 days ago

@fal @threejs Using image-to-video output as motion reference is clever. How did H3 hold up on identity across the 8 clips? Keeping the subject consistent as the camera moves is the make-or-break for our 360° orbits, curious if the motion matching smooths over any drift.

Brjan | AI Builder's profile picture
Brjan | AI Builder7 days ago

@fal @threejs the neurally motion-matched aspect must create such a unique flow in animations

Nox|'s profile picture
Nox|6 days ago

@fal @threejs Unreal Engine? How did you achieve Lumen lighting in threejs? Could you share a link to a demo?

Majid Manzarpour's profile picture
Majid Manzarpour7 days ago

@fal @threejs feels pretty good, cool workflow

Matt's profile picture
Matt7 days ago

@fal @threejs It is cool! Incredibly fast and low token cost too. A new set of animations takes about 20 mins including vid gen & gait matching

1Broom's profile picture
1Broom7 days ago

@fal @threejs Generated clips standing in for a mocap suit is a clever loop. Foot contact on the vault is usually where source footage slips, so curious how many passes it needed to get those plants to stick.

Dog of Wolf Street's profile picture
Dog of Wolf Street6 days ago

@fal @threejs That's amazing - how do you bring the SMPL-X motion to the game skeleton? SMPL-X Blender add-on, or something else?

Related Videos