Loading video...

Video Failed to Load

Go Home

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

measure_plan's profile picture

AA

26,179 subscribers

45,906 views • 9 months ago •via X (Twitter)

GamingArtsScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

forcing myself to workout with mediapipe computer vision, threejs, and gemini 3 code and live demo available if you want to join my pain
0:37

forcing myself to workout with mediapipe computer vision, threejs, and gemini 3 code and live demo available if you want to join my pain

AA

304,436 views • 6 months ago

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
0:58

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

221,656 views • 1 year ago

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴
0:32

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴

AA

70,448 views • 11 months ago

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
1:12

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

24,376 views • 1 year ago

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?
1:02

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?

AA

27,819 views • 1 year ago

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js
0:59

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

164,176 views • 1 year ago

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴
1:00

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴

AA

84,065 views • 1 year ago

i started making a new game the mission: control a robot with hand movements, smash some buildings, dodge some tanks created with threejs, rapier physics, mediapipe computer vision, gemini 3, my macbook webcam continuing my journey to resurrect wii-kinect-eyetoy AR games :)
0:21

i started making a new game the mission: control a robot with hand movements, smash some buildings, dodge some tanks created with threejs, rapier physics, mediapipe computer vision, gemini 3, my macbook webcam continuing my journey to resurrect wii-kinect-eyetoy AR games :)

AA

72,773 views • 7 months ago

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below
0:52

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below

AA

30,775 views • 1 year ago

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision
1:02

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision

AA

43,550 views • 1 year ago

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below
0:39

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below

AA

31,936 views • 1 year ago

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments
0:35

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

AA

14,429 views • 11 months ago

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below
0:40

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

AA

244,071 views • 1 year ago

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint
0:32

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint

AA

41,999 views • 1 year ago

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control
0:38

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control

Yu Xiang

29,338 views • 2 months ago

Another unreleased shader - Puddle with raindrops, splashes, ripples and lightning. Of course, all #threejs and #r3f. Best witih sound. Dont forget to hit "Start" on the demo page! Live: Code:
0:20

Another unreleased shader - Puddle with raindrops, splashes, ripples and lightning. Of course, all #threejs and #r3f. Best witih sound. Dont forget to hit "Start" on the demo page! Live: Code:

Faraz

33,915 views • 1 year ago

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples
0:44

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples

AA

18,605 views • 5 months ago

i made an RPG inventory system where you point at objects to collect them irl built with roboflow RF-DETR object recognition, mediapipe hand tracking, and javascript (this runs live in the browser) collecting the apple gave me +10 hp
0:22

i made an RPG inventory system where you point at objects to collect them irl built with roboflow RF-DETR object recognition, mediapipe hand tracking, and javascript (this runs live in the browser) collecting the apple gave me +10 hp

AA

21,697 views • 2 months ago

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below
1:00

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below

AA

40,230 views • 1 year ago