this project is now open source (🔗 in comments) make music in the browser by waving your hands in front of your webcam created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

Github: Live demo:

@AndrewVoirol @threejs @Rosebud_AI 🔥🔥🔥

@AndrewVoirol @threejs @Rosebud_AI ty! your pfp is making me hungry

@threejs @Rosebud_AI Alright, it's challenge time😀 A virtual stylophone / theremin, and this classic:

@threejs @Rosebud_AI bro it will take me 1000 hours to attempt this, and I will still fail 🪦 such a cool song

@threejs @Rosebud_AI thats actually pretty neat

@threejs @Rosebud_AI Put it on @huggingface and tokenize it with our Modelz platform launching July 10th. Test the beta out now!

Yeah, this is very cool. And not to throw any shade at the “DJs“ out there that just like to spend some knobs and throw their hands up in the air at a crowd as they simply play a track they may or may not have produced. This will actually give someone the chance to Produce something by waving their hands.

@threejs @Rosebud_AI ty Andrew 🙇‍♂️ would be very fun to integrate this with some turntables and mixing gear

@threejs @Rosebud_AI digital theremin!

@threejs @Rosebud_AI I always loved the spacey sound of a theremin, this is my attempt (with bonus drums)