Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please...

measure_plan's profile picture

AA

5,170 subscribers

31,936 Aufrufe • vor 1 Jahr •via X (Twitter)

KunstWissenschaft & TechnologieGaming
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von AA
AAvor 1 Jahr

Demo:

Profilbild von HUDI
HUDIvor 2 Jahren

Introducing IPDW 🌍✨- A leap towards Web 4.0 with our InterPlanetary Data Wallet! Without blockchain, it enables a peer-to-peer internet inspired by BitTorrent and IPFS. 🐸Discover how IPDW is reshaping digital autonomy, making every user a node in a vast, secure network. Ready to explore a new dimension of the internet? 👉

Profilbild von Jeremy Nguyen ✍🏼 🚢
Jeremy Nguyen ✍🏼 🚢vor 1 Jahr

@threejs @Rosebud_AI So good, Alan! It'd be awesome to be able to manipulate our Obsidian graph views like this.

Profilbild von AA
AAvor 1 Jahr

@threejs @Rosebud_AI That’s a cool idea. I’ve seen lots of glowing reviews for Obsidian but here I am using a pen + notebook 🫣

Profilbild von Alex
Alexvor 1 Jahr

@threejs @Rosebud_AI Have you considered using this with a projector instead of a monitor? Would look cool manipulating objects as they're projected on a wall.

Profilbild von AA
AAvor 1 Jahr

@threejs @Rosebud_AI that would be awesome, thanks for the suggestion! Need to get my hands on a projector to try I also want to buy some AR glasses now after doing these experiments. The wish list is growing lol

Profilbild von renderfiction
renderfictionvor 1 Jahr

@threejs @Rosebud_AI You combined all of my favorite features! Voice commands, slick UI, and manipulating vertices. 🔥🔥

Profilbild von AA
AAvor 1 Jahr

@threejs @Rosebud_AI The iron man interface is coming together 🦾 thank you friend!

Profilbild von K3ith.AI
K3ith.AIvor 1 Jahr

@threejs @Rosebud_AI Do the tutorial!🤩🥳🦾

Profilbild von Hien Phan
Hien Phanvor 1 Jahr

@threejs @Rosebud_AI this is tony's son is learning some 3d chemistry :)

Profilbild von AA
AAvor 1 Jahr

@threejs @Rosebud_AI Jarvis, what's a molecule?

Ähnliche Videos

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below
0:52

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below

AA

30,775 Aufrufe • vor 1 Jahr

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below
1:00

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below

AA

40,230 Aufrufe • vor 1 Jahr

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?
1:02

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?

AA

27,386 Aufrufe • vor 11 Monaten

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
1:12

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

24,376 Aufrufe • vor 1 Jahr

operating my computer with voice + hand gestures 📎 🖥️ introducing Iron OS: it's like a regular computer, but much more inconvenient created with Three.js, Rosebud AI, and mediapipe computer vision 🔗demo link below
0:49

operating my computer with voice + hand gestures 📎 🖥️ introducing Iron OS: it's like a regular computer, but much more inconvenient created with Three.js, Rosebud AI, and mediapipe computer vision 🔗demo link below

AA

30,648 Aufrufe • vor 1 Jahr

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint
0:32

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint

AA

41,999 Aufrufe • vor 1 Jahr

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!
0:58

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

221,466 Aufrufe • vor 1 Jahr

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴
1:00

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴

AA

84,065 Aufrufe • vor 10 Monaten

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.
0:12

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.

AA

19,426 Aufrufe • vor 11 Monaten

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴
0:32

3D design using hand gestures voxels are laid onto a parametric surface, with controls for amplitude, frequency, and color palette created with grok 4, threejs, and mediapipe AI vision 🧵 live demo, code, and tutorial ↴

AA

69,950 Aufrufe • vor 9 Monaten

it's a rainy friday afternoon, so I'm working on more Tony Stark lab technology 🦾 controlling a 3D globe with hand gestures, powered by Three.js, Cesium, MediaPipe computer vision, and my laptop webcam kindly leave a comment if you'd like a tutorial on building this (step-by-step with code and prompts). If there's interest I'll put that together next week :)
0:50

it's a rainy friday afternoon, so I'm working on more Tony Stark lab technology 🦾 controlling a 3D globe with hand gestures, powered by Three.js, Cesium, MediaPipe computer vision, and my laptop webcam kindly leave a comment if you'd like a tutorial on building this (step-by-step with code and prompts). If there's interest I'll put that together next week :)

AA

36,477 Aufrufe • vor 1 Jahr

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js
0:59

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

164,150 Aufrufe • vor 1 Jahr

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision
1:02

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision

AA

43,550 Aufrufe • vor 1 Jahr

I'm making a virtual drum machine who wants to make a band? 🤠 created with Three.js, Rosebud AI, mediapipe computer vision inspired by maxwell neely-cohen's 10k drum machines project 🔗 demo below if you want to try
0:47

I'm making a virtual drum machine who wants to make a band? 🤠 created with Three.js, Rosebud AI, mediapipe computer vision inspired by maxwell neely-cohen's 10k drum machines project 🔗 demo below if you want to try

AA

23,931 Aufrufe • vor 1 Jahr

In graph theory, there are algorithms that find the shortest path between two nodes. I made one with pure CSS (including the graph drawing). Drag the nodes, and the shortest path will update in real-time! A demo powered by all the modern CSS features🤩
0:36

In graph theory, there are algorithms that find the shortest path between two nodes. I made one with pure CSS (including the graph drawing). Drag the nodes, and the shortest path will update in real-time! A demo powered by all the modern CSS features🤩

CSS by T. Afif

1,200,275 Aufrufe • vor 3 Monaten

totally blown away by Google Gemini 3 + three.js.. just generated a 3D product interactive app with zero coding.. use hand gesture to rotate, scale, control xyz and lighting of 3D model AI is taking over.. accept or not tutorial with prompts & code below:
0:23

Sensitive content

totally blown away by Google Gemini 3 + three.js.. just generated a 3D product interactive app with zero coding.. use hand gesture to rotate, scale, control xyz and lighting of 3D model AI is taking over.. accept or not tutorial with prompts & code below:

el.cine

415,211 Aufrufe • vor 5 Monaten

I made a web game. It's called DVD Dodge 📀 Avoid the bouncing DVD logo and collect coins. You'll need to dodge, duck, dip, dive and dodge your way to success 🤸‍♀️ To play you just need a regular webcam a willingness to embarrass yourself in front of your neighbours Created using Three.js, Rosebud AI, and mediapipe computer vision for body pose tracking 🔗 game link below
0:48

I made a web game. It's called DVD Dodge 📀 Avoid the bouncing DVD logo and collect coins. You'll need to dodge, duck, dip, dive and dodge your way to success 🤸‍♀️ To play you just need a regular webcam a willingness to embarrass yourself in front of your neighbours Created using Three.js, Rosebud AI, and mediapipe computer vision for body pose tracking 🔗 game link below

AA

308,590 Aufrufe • vor 1 Jahr

I made a web game You protect kittens with eye lasers Made with Three.js, mediapipe AI vision, and endless inspiration from nolen 🔗 game link below
0:55

I made a web game You protect kittens with eye lasers Made with Three.js, mediapipe AI vision, and endless inspiration from nolen 🔗 game link below

AA

109,259 Aufrufe • vor 10 Monaten

this project is now open source (🔗 in comments) make music in the browser by waving your hands in front of your webcam created with Three.js, Rosebud AI, mediapipe computer vision, tone.js
0:48

this project is now open source (🔗 in comments) make music in the browser by waving your hands in front of your webcam created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

92,698 Aufrufe • vor 1 Jahr

Building Three.js shaders is about to get a whole lot easier! 👍 Introducing Three.js Shader Graph — visual node-based editing for TSL. 🖱️Drag & drop nodes 📺Real-time 3D preview 🔄Auto-generate TSL code in realtime Join the waitlist 👉🏻 #threejs #webgl #webgpu #shaders
1:46

Building Three.js shaders is about to get a whole lot easier! 👍 Introducing Three.js Shader Graph — visual node-based editing for TSL. 🖱️Drag & drop nodes 📺Real-time 3D preview 🔄Auto-generate TSL code in realtime Join the waitlist 👉🏻 #threejs #webgl #webgpu #shaders

Dan Greenheck

34,219 Aufrufe • vor 5 Monaten