Loading video...

Video Failed to Load

Go Home

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

measure_plan's profile picture

AA

19,730 subscribers

45,607 views • 8 months ago •via X (Twitter)

GamingArtsScience & Technology
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

forcing myself to workout with mediapipe computer vision, threejs, and gemini 3 code and live demo available if you want to join my pain
0:37

forcing myself to workout with mediapipe computer vision, threejs, and gemini 3 code and live demo available if you want to join my pain

AA

304,326 views • 5 months ago

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
0:58

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

221,612 views • 1 year ago

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴
0:32

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴

AA

70,448 views • 10 months ago

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
1:12

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

24,376 views • 1 year ago

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?
1:02

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?

AA

27,819 views • 1 year ago

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js
0:59

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

164,176 views • 1 year ago

another #threejs / #tonejs av experiment using mediapipe face tracking in the browser.
1:42

another #threejs / #tonejs av experiment using mediapipe face tracking in the browser.

vincemckelvie

12,994 views • 3 years ago

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js
0:41

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js

Suryansh Chourasia

11,676 views • 7 months ago

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴
1:00

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴

AA

84,065 views • 11 months ago

i started making a new game the mission: control a robot with hand movements, smash some buildings, dodge some tanks created with threejs, rapier physics, mediapipe computer vision, gemini 3, my macbook webcam continuing my journey to resurrect wii-kinect-eyetoy AR games :)
0:21

i started making a new game the mission: control a robot with hand movements, smash some buildings, dodge some tanks created with threejs, rapier physics, mediapipe computer vision, gemini 3, my macbook webcam continuing my journey to resurrect wii-kinect-eyetoy AR games :)

AA

72,761 views • 7 months ago

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below
0:52

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below

AA

30,775 views • 1 year ago

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision
1:02

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision

AA

43,550 views • 1 year ago

i connected my piano to threejs and made an audioreactive midi visualizer
0:21

i connected my piano to threejs and made an audioreactive midi visualizer

AA

470,151 views • 5 months ago

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below
0:39

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below

AA

31,936 views • 1 year ago

do a push-up, save a puppy 🐾 I made this fitness game with mediapipe AI vision, Three.js, and tonejs for sound effects which exercise should I add next?
0:41

do a push-up, save a puppy 🐾 I made this fitness game with mediapipe AI vision, Three.js, and tonejs for sound effects which exercise should I add next?

AA

29,366 views • 1 year ago

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments
0:35

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

AA

14,429 views • 10 months ago

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below
0:40

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

AA

244,071 views • 1 year ago

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint
0:32

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint

AA

41,999 views • 1 year ago

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control
0:38

We (Luis Felipe Casas and I) handed out 21 NVIDIA #Jetson Orin Nano kits to students in my computer vision class this semester. All teams showcased their live Jetson-powered demos in the classroom at the end of the course! Here are a few sample projects👇 1. Hand gesture for control

Yu Xiang

29,338 views • 2 months ago