正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

say hello to my little friend 🤖 3D model control (move, rotate, scale, animate) using hand gestures and voice commands, running in real-time in the browser! created with Three.js, Rosebud AI, mediapipe computer vision, and web speech API credit to Quaternius for the robot model 🔗 demo below

AA

4,997 subscribers

30,775 次观看 • 1 年前 •via X (Twitter)

艺术科学技术游戏

Anya Rossi• Live Now

Private livecam show

12 条评论

AA 的头像

AA1 年前

Demo:

Bytescribe 的头像

Bytescribe1 年前

Introducing Vehrbal, the AI that converts audio into SOAP notes! Say goodbye to wasted time and hello to effortless note-taking. Experience the power of fast, simple, and efficient with Vehrbal today.

Rizz | Art & FilmMaking 的头像

Rizz | Art & FilmMaking1 年前

@threejs @Rosebud_AI @quaternius helloo

AA 的头像

AA1 年前

@threejs @Rosebud_AI @quaternius Stan the robot appreciates your greeting 👋

loulou 的头像

loulou1 年前

@threejs @Rosebud_AI @quaternius Love the robot, he looks like a good friend 👊

AA 的头像

AA1 年前

@threejs @Rosebud_AI @quaternius he woke up and chose violence this morning 🤦‍♂️

Abdel Latrache 的头像

Abdel Latrache1 年前

@threejs @Rosebud_AI @quaternius Hello 👋

AA 的头像

AA1 年前

@threejs @Rosebud_AI @quaternius Mr. Robot is mostly getting bossed around, so he appreciates the greeting 👋

MoneyPipez 的头像

MoneyPipez1 年前

@threejs @Rosebud_AI @quaternius You easily have some of the most interesting content on here. Keep it up!

AA 的头像

AA1 年前

@threejs @Rosebud_AI @quaternius that's very kind, thank you!! If you have any ideas for demos or use cases for this hand tracking / voice command stuff, please let me know 🙇‍♂️

Devinci 的头像

Devinci1 年前

@threejs @Rosebud_AI @quaternius What do you use for motion control?

AA 的头像

AA1 年前

@threejs @Rosebud_AI @quaternius I’m using mediapipe computer vision for the hand tracking and control

相关视频

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below

I've open sourced this project! - use voice commands to change interaction mode (drag, rotate, scale, animate) - use hand gestures to control the 3D model - drag/drop to import other models (only GLTF format supported rn) created using Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Quaternius 3D models 🔗 github repo below

AA

40,230 次观看 • 1 年前

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below

Controlling a 3D graph with hand + voice commands ❋ Using speech recognition to toggle between drag / rotate / zoom interactions, and hand gestures to move the nodes of the graph Created with Three.js, Rosebud AI, mediapipe computer vision, web speech API, and Vasco Asturiano's 3D-force-graph library Please comment if you'd like a tutorial for this 🔗 demo link below

AA

31,936 次观看 • 1 年前

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

Controlling a 3D particle animation with hand gestures / voice 🎇🤖 "Jarvis, change to a sphere" > voice commands trigger a transformation into different shape types > hand gestures control the rotation speed and zoom created with Three.js, mediapipe computer vision, and web speech API. Runs in real-time in the browser, using a regular webcam / mic 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

24,376 次观看 • 1 年前

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?

controlling a 3D globe with hand gestures 🌎 map zoom, rotation, layer view toggle runs in real-time on the web with a regular laptop + webcam created with Cesium, Three.js, and mediapipe computer vision 🔗 demo + code + tutorial below GeoGuessr next?

AA

27,819 次观看 • 1 年前

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

creating / controlling 3D shapes with hand gestures 👋💠 built with Three.js and MediaPipe computer vision 🔗 demo + code in the comments let me know of any requests for future demos / tutorials!

AA

221,612 次观看 • 1 年前

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴

i made a tutorial for my 3D data visualization project it's how I imagine Tony Stark and Jarvis doing data analysis :] built with Three.js, mediapipe AI vision, and web speech API thread below with the code, tutorial, and live demo ↴

AA

84,065 次观看 • 11 个月前

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

i'm making a musical instrument rotate your hands to change tempo and note cycles experimenting with an audio-reactive radial UI design created with grok 4, mediapipe AI vision, tonejs, Three.js 🔗 runs in real-time in the browser, link in comments

AA

14,429 次观看 • 11 个月前

this project is now open source (🔗 in comments) make music in the browser by waving your hands in front of your webcam created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

this project is now open source (🔗 in comments) make music in the browser by waving your hands in front of your webcam created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

92,790 次观看 • 1 年前

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

hand-controlled arpeggiator, drum machine, and audio reactive visualizer 🪬 do you want the code for this? created with Three.js, Rosebud AI, mediapipe computer vision, tone.js

AA

164,176 次观看 • 1 年前

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint

Windows 98 x Jarvis 🗒️🤖 This UI is controlled using only hand gestures and voice. Built with Three.js, mediapipe computer vision, and web speech API Kindly leave a comment if you'd like a tutorial on building this (with code and prompts). If there's interest I'll put it together @levelsio plz send help, I'm stuck inside MS Paint

AA

41,999 次观看 • 1 年前

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

AA

244,071 次观看 • 1 年前

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision

Editing 3D shapes with hand gestures 👋♦️ Let me know if you want to try it / see the code. It's WIP and clunky but I can clean it up and publish Created with Three.js and mediapipe computer vision

AA

43,550 次观看 • 1 年前

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples

AA

18,605 次观看 • 5 个月前

I vibecoded a new game this morning: the floor is lava ♨️ Save our cactus friend from pits of lava by jumping around your living room 🌵 Created with Three.js, Rosebud AI, and MediaPipe computer vision (body pose model). The game is free and live on the web now! Just need a regular webcam to play. Code is also open source ↴

I vibecoded a new game this morning: the floor is lava ♨️ Save our cactus friend from pits of lava by jumping around your living room 🌵 Created with Three.js, Rosebud AI, and MediaPipe computer vision (body pose model). The game is free and live on the web now! Just need a regular webcam to play. Code is also open source ↴

AA

47,670 次观看 • 1 年前

I made a web game. It's called DVD Dodge 📀 Avoid the bouncing DVD logo and collect coins. You'll need to dodge, duck, dip, dive and dodge your way to success 🤸‍♀️ To play you just need a regular webcam a willingness to embarrass yourself in front of your neighbours Created using Three.js, Rosebud AI, and mediapipe computer vision for body pose tracking 🔗 game link below

AA

308,689 次观看 • 1 年前

totally blown away by Google Gemini 3 + three.js.. just generated a 3D product interactive app with zero coding.. use hand gesture to rotate, scale, control xyz and lighting of 3D model AI is taking over.. accept or not tutorial with prompts & code below:

Sensitive content

totally blown away by Google Gemini 3 + three.js.. just generated a 3D product interactive app with zero coding.. use hand gesture to rotate, scale, control xyz and lighting of 3D model AI is taking over.. accept or not tutorial with prompts & code below:

el.cine

416,198 次观看 • 6 个月前

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.

OpenAI

22,808,847 次观看 • 2 年前

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

adding computer vision to the marble aquarium hand gesture control for brightness, animation speed, rotation an audioreactive webapp built with threejs, tonejs, mediapipe code and live demo ↓

AA

45,607 次观看 • 8 个月前

Still rigging and animating 3D models by hand? STOP and instead start using Animate Anything, the latest AI tool on the block for 3D animation. Goodbye rigging and hello to Animate Anything (links below)

Still rigging and animating 3D models by hand? STOP and instead start using Animate Anything, the latest AI tool on the block for 3D animation. Goodbye rigging and hello to Animate Anything (links below)

Linus ✦ Ekenstam

250,039 次观看 • 2 年前