hand interface debug mode 🔵🔴🟡🟢

non-debug example here —

Whoa, I love how responsive this is. Smooth FPS and no glitches.

all done in-browser too! 13ms inference per frame on the m1 max 💨

open your mouth

👁️🔴👁️

Reminds me of Baldessari

Someone give this some squish or bike-horn foley and we're all set.

So cool! I wish it wasn’t so fatiguing to use our hands this way for interfaces

yeah, agreed. finger and joint motion also requires a fair bit of calibration beforehand. good for quick playful interfaces though!

This is wild! Is this in browser?

yeah! this is actually just a screen recording of a <video /> element with a <canvas /> overlaid on it. sub-16ms inference per-frame using