Made a realtime OpenPose #ControlNet controller for #StableDiffusion in #Unity3D using the Animation Rigging package + Runtime Transform Handles asset. First time doing rigging inside Unity and found it quite intuitive. #madewithunity #gamedev #indiedev

No way! Damn, thats fantastic

Thank you!! Will release the code once I strip the third party assets

any chance you can share the fbx model? Looking to do this in iclone using live mocap, but can model worth a damn.

Sure here's the skinned mesh with vertex colors

Whoa, this looks cool! I need to try this out soon!

Been waiting for a poser with inverse kinematics like this. It looks amazing, good job. ✌

holy crap

wtf kid! stopppppppp

Thank you so much for sharing!

How did you incorporate SD into unity here?

For this version I have Auto1111 WebUI running on my machine and I’m interfacing through its api for the ControlNet feature. I’m also building other features that can use cloud gpu api and eventually a fully self contained SD implementation with custom trained models.