Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

another #threejs / #tonejs av experiment using mediapipe face tracking in the browser.

vincemckelvie

1,463 subscribers

12,994 views • 3 years ago •via X (Twitter)

#threejs #tonejs

Anya Rossi• Live Now

Private livecam show

9 Comments

ghosthabanero.eth (👻,🌶)3 years ago

That’s an awesome setup

Steve Teeps3 years ago

If you could do all our discord calls with this enabled going forward that would be wonderful. (Also this is sick)

time3 years ago

epic work keep going 🌌 [ research eternal ] @neotekka look at this i love when the timeline shows me the rare music art technology humans

saint alex3 years ago

another banger 💥💥

MEKANIX3 years ago

🤠🍄🤠

🔑3 years ago

@mashine_eth this is so dank

Peter Puskas3 years ago

Sick

Zora Jones3 years ago

ur on a rollllllll 🔥🔥🔥🔥🔥🔥

vincemckelvie3 years ago

haha it takes me a really long time to get a usable take

Related Videos

Off-axis projection experiment no. 2 mediapipe for face tracking, sparkjs for gaussian splat rendering via threejs

Off-axis projection experiment no. 2 mediapipe for face tracking, sparkjs for gaussian splat rendering via threejs

Ian Curtis

51,726 views • 5 months ago

i hacked together a voxel editor using mediapipe hand tracking, threejs, and my macbook webcam one day i'll get some real AR glasses

i hacked together a voxel editor using mediapipe hand tracking, threejs, and my macbook webcam one day i'll get some real AR glasses

AA

166,024 views • 7 months ago

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

AA

244,071 views • 11 months ago

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

AA

45,607 views • 8 months ago

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Experimenting with environment styles in my off-axis projection demo. These are Gaussian splats rendered in the browser, switching via keyboard. -> Blender basic layout -> World Labs (chisel) -> three.js / Spark 2.0 -> Mediapipe (face-tracking)

Ian Curtis

76,943 views • 3 months ago

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js

gemini 3 pro: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, next js

Suryansh Chourasia

11,673 views • 7 months ago

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

AA

14,429 views • 10 months ago

i made a 3D stained glass type design tool it renders live in the browser using threejs and webgl shaders

i made a 3D stained glass type design tool it renders live in the browser using threejs and webgl shaders

AA

47,343 views • 2 months ago

vibe coding with threejs in the browser btw

vibe coding with threejs in the browser btw

robot

14,544 views • 7 days ago

Day 2! 🖐️ The hand tracking experiment in your browser keeps growing. Added a character gallery, Patrick and SpongeBob now stand alongside Squidward, along with their houses, a bubble particle system, and extra assets. Honestly, building with Omma AI right now is just too much fun. #threeJs

Day 2! 🖐️ The hand tracking experiment in your browser keeps growing. Added a character gallery, Patrick and SpongeBob now stand alongside Squidward, along with their houses, a bubble particle system, and extra assets. Honestly, building with Omma AI right now is just too much fun. #threeJs

Joseph Azar

35,414 views • 10 days ago

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Softbodies by holtsetio Realtime Tetrahedral FEM Models in the Browser, using WebGPU and written in TSL. Based on the WebGL implementation in TetSim by Johnathon Selstad, upgraded to enable collisions.

Three.js

25,516 views • 1 year ago

i made an RPG inventory system where you point at objects to collect them irl built with roboflow RF-DETR object recognition, mediapipe hand tracking, and javascript (this runs live in the browser) collecting the apple gave me +10 hp

i made an RPG inventory system where you point at objects to collect them irl built with roboflow RF-DETR object recognition, mediapipe hand tracking, and javascript (this runs live in the browser) collecting the apple gave me +10 hp

AA

21,697 views • 1 month ago

A simple tracking showcase using the Paper_Tracker Face + Eye Tracking Full Kit with Quest 3.

A simple tracking showcase using the Paper_Tracker Face + Eye Tracking Full Kit with Quest 3.

Paper_Tracker

52,087 views • 22 days ago

Introducing Gestalt 3D Modeling in the Browser Open Source, powered by ThreeJS Keyboard Shortcuts stolen from Blender Design in your browser, export anywhere ✌️

Introducing Gestalt 3D Modeling in the Browser Open Source, powered by ThreeJS Keyboard Shortcuts stolen from Blender Design in your browser, export anywhere ✌️

robot

42,380 views • 10 months ago

its coming along ... infinite world: in the browser, biomes, wind and much more... 🔊 #threejs #webgl

its coming along ... infinite world: in the browser, biomes, wind and much more... 🔊 #threejs #webgl

HeyOz

50,969 views • 3 years ago

i made a pendulum simulator 16 pendulums oscillate through wave patterns making music along the way built with kimi k2.6, threejs, tonejs you are getting very sleepy ..

i made a pendulum simulator 16 pendulums oscillate through wave patterns making music along the way built with kimi k2.6, threejs, tonejs you are getting very sleepy ..

AA

65,813 views • 2 months ago

Update on my hand-tracking pottery app 🏺 New features just dropped: - Colorize your clay in real time - Change the shape of the clay base Got a webcam? Use your hands. Don't have one? Your mouse works just as well. Everything built within Omma + threeJs + mediaPipe Demo link in the comments 👇

Update on my hand-tracking pottery app 🏺 New features just dropped: - Colorize your clay in real time - Change the shape of the clay base Got a webcam? Use your hands. Don't have one? Your mouse works just as well. Everything built within Omma + threeJs + mediaPipe Demo link in the comments 👇

Joseph Azar

13,973 views • 1 month ago

Fable has solved 3D worldbuilding... utterly insane. This is all completely custom-built ThreeJs, running in the browser.

Fable has solved 3D worldbuilding... utterly insane. This is all completely custom-built ThreeJs, running in the browser.

Matt Shumer

1,436,936 views • 23 days ago

it's day 2 of making minecraft* in the browser *except it's way less convenient because the only way to control the game is by waving your hands around i added a GTA radial menu to choose between characters (all 3D models by quaternius) tech stack: mediapipe computer vision, threejs, gemini 3, my macbook webcam

it's day 2 of making minecraft* in the browser *except it's way less convenient because the only way to control the game is by waving your hands around i added a GTA radial menu to choose between characters (all 3D models by quaternius) tech stack: mediapipe computer vision, threejs, gemini 3, my macbook webcam

AA

160,016 views • 7 months ago

threejs in the browser, now with reflections (SSR) starting to feel the AAA? vibe coded with codex and no AC in europe

threejs in the browser, now with reflections (SSR) starting to feel the AAA? vibe coded with codex and no AC in europe

robot 2.0

21,140 views • 4 days ago