Loading video...

Video Failed to Load

Go Home

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)

measure_plan's profile picture

AA

25,511 subscribers

48,020 views • 3 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

i made Dumb Drum Revolution. smack everyday objects to create "music" built with: - roboflow RF-DETR for object detection - mediapipe hand tracking - web audio API and some drum samples runs in realtime in the browser for all your drumming needs
0:18

i made Dumb Drum Revolution. smack everyday objects to create "music" built with: - roboflow RF-DETR for object detection - mediapipe hand tracking - web audio API and some drum samples runs in realtime in the browser for all your drumming needs

AA

72,801 views • 4 months ago

another experiment with fruit, computer vision, and projection mapping live object detections (roboflow RF-DETR model) are used to control the animated scene (threejs) i also added mediapipe segmentation to the pipeline to create collisions with my silhouette, but i haven't gotten a hang of it yet more experiments are underway
0:16

another experiment with fruit, computer vision, and projection mapping live object detections (roboflow RF-DETR model) are used to control the animated scene (threejs) i also added mediapipe segmentation to the pipeline to create collisions with my silhouette, but i haven't gotten a hang of it yet more experiments are underway

AA

21,581 views • 1 month ago

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.
0:18

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.

Amos Gyamfi

15,373 views • 13 days ago

i made donkey kong but you play with pushups and planks and it's quite inconvenient made with javascript, canvas, roboflow RF-DETR (for banana detection), and mediapipe body pose tracking lmk if you want to play a few fitness games like this and i'll try to get these online
0:18

i made donkey kong but you play with pushups and planks and it's quite inconvenient made with javascript, canvas, roboflow RF-DETR (for banana detection), and mediapipe body pose tracking lmk if you want to play a few fitness games like this and i'll try to get these online

AA

130,176 views • 3 months ago

We just shipped React Native ExecuTorch v0.8.0 – our biggest release yet! 👏🏼 ➡️ Vision Camera integration that runs computer vision models directly on your camera feed, in realtime. Also new: multiple CV models (including RF-DETR (Roboflow) and Liquid AI's Vision Language), Bare React Native support, and more. Takes minutes to try – check out the repo! ⬇️
0:12

We just shipped React Native ExecuTorch v0.8.0 – our biggest release yet! 👏🏼 ➡️ Vision Camera integration that runs computer vision models directly on your camera feed, in realtime. Also new: multiple CV models (including RF-DETR (Roboflow) and Liquid AI's Vision Language), Bare React Native support, and more. Takes minutes to try – check out the repo! ⬇️

Software Mansion

37,099 views • 3 months ago

RF-DETR is now available in Hugging Face transformers state of the art in both detection and segmentation, outperforming YOLO architectures - checkpoints: - demo: - docs:
0:11

RF-DETR is now available in Hugging Face transformers state of the art in both detection and segmentation, outperforming YOLO architectures - checkpoints: - demo: - docs:

SkalskiP

79,277 views • 1 month ago

introducing: The Claw a webgame built with threejs, mediapipe computer vision, and gemini 3 how many alien friends can you save?
0:18

introducing: The Claw a webgame built with threejs, mediapipe computer vision, and gemini 3 how many alien friends can you save?

AA

64,456 views • 7 months ago

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄
0:13

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄

merve

56,682 views • 1 month ago

Real-time DEtection Transformer (RT-DETR) landed in Hugging Face transformers 🤩 with Apache 2.0 license 😍 do DETRs Beat YOLOs on Real-time Object Detection? keep reading 👀
0:18

Real-time DEtection Transformer (RT-DETR) landed in Hugging Face transformers 🤩 with Apache 2.0 license 😍 do DETRs Beat YOLOs on Real-time Object Detection? keep reading 👀

merve

155,222 views • 2 years ago

gemini 3: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, and javascript
0:14

gemini 3: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, and javascript

AA

218,746 views • 7 months ago

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback
0:10

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback

AA

300,872 views • 29 days ago

i built an app to search old travel photos on my computer with natural language queries using free local AI models: - smolVLM to describe the scene and colours - roboflow RF-DETR to detect objects - chromaDB to store metadata labels and run semantic search - python + streamlit for the interface fast and free search has been achieved internally
0:19

i built an app to search old travel photos on my computer with natural language queries using free local AI models: - smolVLM to describe the scene and colours - roboflow RF-DETR to detect objects - chromaDB to store metadata labels and run semantic search - python + streamlit for the interface fast and free search has been achieved internally

AA

41,823 views • 3 months ago

smart parking demo - RF-DETR - license plate detection - OC-SORT - multi-object tracking - GLM-OCR - reading license plates on Monday I showed you trackers, yesterday GLM-OCR, today I'm putting everything together
0:17

smart parking demo - RF-DETR - license plate detection - OC-SORT - multi-object tracking - GLM-OCR - reading license plates on Monday I showed you trackers, yesterday GLM-OCR, today I'm putting everything together

SkalskiP

26,206 views • 3 months ago

The NEW YORK KNICKS championship inspired me to build an AI basketball coach to improve my 1v1 game Built with: - Robloflow RF-DETR to detect players/ball/rim - MediaPipe to capture body angles - OpenCV to analyze and annotate the clip
0:10

The NEW YORK KNICKS championship inspired me to build an AI basketball coach to improve my 1v1 game Built with: - Robloflow RF-DETR to detect players/ball/rim - MediaPipe to capture body angles - OpenCV to analyze and annotate the clip

Pat

192,000 views • 13 days ago

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game
0:17

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game

AA

40,130 views • 7 months ago

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.
0:16

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince Canuma

180,321 views • 3 months ago

Designing glassware in the browser - in realtime - with physical thickness simulation made with Three.js and Needle
0:18

Designing glassware in the browser - in realtime - with physical thickness simulation made with Three.js and Needle

herbst

22,651 views • 11 months ago

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.
0:12

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.

AA

19,435 views • 11 months ago

built a custom video-gen pipeline for drones for making a custom low latency drone detection + tracking + future trajectory prediction pipeline with 3D reconstruction. based on modern stack involving Roboflow and Ultralytics for custom data pipeline and model building and Rerun for visualisation...
0:10

built a custom video-gen pipeline for drones for making a custom low latency drone detection + tracking + future trajectory prediction pipeline with 3D reconstruction. based on modern stack involving Roboflow and Ultralytics for custom data pipeline and model building and Rerun for visualisation...

ud

15,577 views • 5 months ago

I can't stop playing with Rapid Roboflow. The process is so smooth that you can just: - Go to the rapid roboflow platform - Drop a few images or a short video - Type a prompt like “yellow cap” or “person wearing red hat” - Instantly get a working detection model No training, no GPUs, no cloud setup. Plug it straight into your app. It’s also baked into Roboflow Workflows, so you can instantly build automations like “count vials crossing this line” in minutes. Computer vision just went from weeks in seconds.
0:16

I can't stop playing with Rapid Roboflow. The process is so smooth that you can just: - Go to the rapid roboflow platform - Drop a few images or a short video - Type a prompt like “yellow cap” or “person wearing red hat” - Instantly get a working detection model No training, no GPUs, no cloud setup. Plug it straight into your app. It’s also baked into Roboflow Workflows, so you can instantly build automations like “count vials crossing this line” in minutes. Computer vision just went from weeks in seconds.

Marco Franzon

175,930 views • 6 months ago