Semi-realtime Stable Diffusion image-to-image (Van Gogh style), Unity plugin based on Apple's Core ML port. The latency is about 2 seconds on M1 Max MacBook Pro.

Nice! Reminds me of this little experiment I did with minecraft - got it running as a mirror (2-3 second delay on 3090)

This is awesome! Can you pass the scene camera to it?

The repository contains it.

I cloned the plugin and CoreML, but not sure how to use it inside Unity Project. I could not find example project. I asked on Github, maybe there are extra steps or I miss to find anything to get this running?

Nice one, gonna put this into

Bravo, that's some unity next level dev skills, got diffusion inside unity with almost rt cam control feedback on an M1

Didn't parse the git, did you tryed it with ControlNet ?

@bigheeno

Will this run on my ipad air M1 ?

We'll soon have AI transforming our dull selfies into masterpieces 🤔