Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

introducing: fruit xylophone a computer vision music experiment built with mediapipe hand tracking and roboflow RF-DETR object detection (running in realtime in the browser using transformers js)

measure_plan's profile picture

AA

25,511 subscribers

48,020 Aufrufe • vor 3 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

i made Dumb Drum Revolution. smack everyday objects to create "music" built with: - roboflow RF-DETR for object detection - mediapipe hand tracking - web audio API and some drum samples runs in realtime in the browser for all your drumming needs
0:18

i made Dumb Drum Revolution. smack everyday objects to create "music" built with: - roboflow RF-DETR for object detection - mediapipe hand tracking - web audio API and some drum samples runs in realtime in the browser for all your drumming needs

AA

72,693 Aufrufe • vor 3 Monaten

another experiment with fruit, computer vision, and projection mapping live object detections (roboflow RF-DETR model) are used to control the animated scene (threejs) i also added mediapipe segmentation to the pipeline to create collisions with my silhouette, but i haven't gotten a hang of it yet more experiments are underway
0:16

another experiment with fruit, computer vision, and projection mapping live object detections (roboflow RF-DETR model) are used to control the animated scene (threejs) i also added mediapipe segmentation to the pipeline to create collisions with my silhouette, but i haven't gotten a hang of it yet more experiments are underway

AA

21,581 Aufrufe • vor 28 Tagen

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.
0:18

Core AI: Realtime video image detection, tracking, and segmentation with SAM 3 and RF-DETR. All running on-device. I will share the code in the comments.

Amos Gyamfi

15,373 Aufrufe • vor 5 Tagen

i made donkey kong but you play with pushups and planks and it's quite inconvenient made with javascript, canvas, roboflow RF-DETR (for banana detection), and mediapipe body pose tracking lmk if you want to play a few fitness games like this and i'll try to get these online
0:18

i made donkey kong but you play with pushups and planks and it's quite inconvenient made with javascript, canvas, roboflow RF-DETR (for banana detection), and mediapipe body pose tracking lmk if you want to play a few fitness games like this and i'll try to get these online

AA

130,176 Aufrufe • vor 2 Monaten

We just shipped React Native ExecuTorch v0.8.0 – our biggest release yet! 👏🏼 ➡️ Vision Camera integration that runs computer vision models directly on your camera feed, in realtime. Also new: multiple CV models (including RF-DETR (Roboflow) and Liquid AI's Vision Language), Bare React Native support, and more. Takes minutes to try – check out the repo! ⬇️
0:12

We just shipped React Native ExecuTorch v0.8.0 – our biggest release yet! 👏🏼 ➡️ Vision Camera integration that runs computer vision models directly on your camera feed, in realtime. Also new: multiple CV models (including RF-DETR (Roboflow) and Liquid AI's Vision Language), Bare React Native support, and more. Takes minutes to try – check out the repo! ⬇️

Software Mansion

36,833 Aufrufe • vor 3 Monaten

RF-DETR is now available in Hugging Face transformers state of the art in both detection and segmentation, outperforming YOLO architectures - checkpoints: - demo: - docs:
0:11

RF-DETR is now available in Hugging Face transformers state of the art in both detection and segmentation, outperforming YOLO architectures - checkpoints: - demo: - docs:

SkalskiP

79,277 Aufrufe • vor 1 Monat

introducing: The Claw a webgame built with threejs, mediapipe computer vision, and gemini 3 how many alien friends can you save?
0:18

introducing: The Claw a webgame built with threejs, mediapipe computer vision, and gemini 3 how many alien friends can you save?

AA

64,456 Aufrufe • vor 7 Monaten

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄
0:13

RF-DETR just landed to Hugging Face transformers 🥵🔥 sota real-time detection & segmentation models by Roboflow 💜 > play with our real-time demo > fine-tune the models on your use case with our tutorials (takes a toaster's VRAM) > or just hand them to your agents 😄

merve

56,682 Aufrufe • vor 1 Monat

Real-time DEtection Transformer (RT-DETR) landed in Hugging Face transformers 🤩 with Apache 2.0 license 😍 do DETRs Beat YOLOs on Real-time Object Detection? keep reading 👀
0:18

Real-time DEtection Transformer (RT-DETR) landed in Hugging Face transformers 🤩 with Apache 2.0 license 😍 do DETRs Beat YOLOs on Real-time Object Detection? keep reading 👀

merve

155,222 Aufrufe • vor 2 Jahren

gemini 3: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, and javascript
0:14

gemini 3: build a jarvis HUD interface for tony stark a quick experiment with mediapipe computer vision, threejs, and javascript

AA

218,746 Aufrufe • vor 7 Monaten

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback
0:10

i'm building an AI soccer coach to improve my shooting using: - roboflow RF-DETR to detect the ball / net / player - mediapipe to record body angles when striking the ball - python to analyze and annotate the video i'll also try adding a VLM into the pipeline for coaching feedback

AA

300,872 Aufrufe • vor 20 Tagen

i built an app to search old travel photos on my computer with natural language queries using free local AI models: - smolVLM to describe the scene and colours - roboflow RF-DETR to detect objects - chromaDB to store metadata labels and run semantic search - python + streamlit for the interface fast and free search has been achieved internally
0:19

i built an app to search old travel photos on my computer with natural language queries using free local AI models: - smolVLM to describe the scene and colours - roboflow RF-DETR to detect objects - chromaDB to store metadata labels and run semantic search - python + streamlit for the interface fast and free search has been achieved internally

AA

41,823 Aufrufe • vor 3 Monaten

smart parking demo - RF-DETR - license plate detection - OC-SORT - multi-object tracking - GLM-OCR - reading license plates on Monday I showed you trackers, yesterday GLM-OCR, today I'm putting everything together
0:17

smart parking demo - RF-DETR - license plate detection - OC-SORT - multi-object tracking - GLM-OCR - reading license plates on Monday I showed you trackers, yesterday GLM-OCR, today I'm putting everything together

SkalskiP

26,206 Aufrufe • vor 3 Monaten

The NEW YORK KNICKS championship inspired me to build an AI basketball coach to improve my 1v1 game Built with: - Robloflow RF-DETR to detect players/ball/rim - MediaPipe to capture body angles - OpenCV to analyze and annotate the clip
0:10

The NEW YORK KNICKS championship inspired me to build an AI basketball coach to improve my 1v1 game Built with: - Robloflow RF-DETR to detect players/ball/rim - MediaPipe to capture body angles - OpenCV to analyze and annotate the clip

Pat

189,948 Aufrufe • vor 5 Tagen

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game
0:17

gemini: teach me how to fly using mediapipe computer vision and threejs to make a first-person flappy bird game

AA

40,130 Aufrufe • vor 6 Monaten

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.
0:16

Sam 3 by Facebook now on MLX 🚀 Here is a realtime object tracking running on M3 Max 96GB.

Prince Canuma

180,245 Aufrufe • vor 3 Monaten

Designing glassware in the browser - in realtime - with physical thickness simulation made with Three.js and Needle
0:18

Designing glassware in the browser - in realtime - with physical thickness simulation made with Three.js and Needle

herbst

22,651 Aufrufe • vor 10 Monaten

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.
0:12

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.

AA

19,435 Aufrufe • vor 11 Monaten

built a custom video-gen pipeline for drones for making a custom low latency drone detection + tracking + future trajectory prediction pipeline with 3D reconstruction. based on modern stack involving Roboflow and Ultralytics for custom data pipeline and model building and Rerun for visualisation...
0:10

built a custom video-gen pipeline for drones for making a custom low latency drone detection + tracking + future trajectory prediction pipeline with 3D reconstruction. based on modern stack involving Roboflow and Ultralytics for custom data pipeline and model building and Rerun for visualisation...

ud

15,577 Aufrufe • vor 5 Monaten

I can't stop playing with Rapid Roboflow. The process is so smooth that you can just: - Go to the rapid roboflow platform - Drop a few images or a short video - Type a prompt like “yellow cap” or “person wearing red hat” - Instantly get a working detection model No training, no GPUs, no cloud setup. Plug it straight into your app. It’s also baked into Roboflow Workflows, so you can instantly build automations like “count vials crossing this line” in minutes. Computer vision just went from weeks in seconds.
0:16

I can't stop playing with Rapid Roboflow. The process is so smooth that you can just: - Go to the rapid roboflow platform - Drop a few images or a short video - Type a prompt like “yellow cap” or “person wearing red hat” - Instantly get a working detection model No training, no GPUs, no cloud setup. Plug it straight into your app. It’s also baked into Roboflow Workflows, so you can instantly build automations like “count vials crossing this line” in minutes. Computer vision just went from weeks in seconds.

Marco Franzon

175,930 Aufrufe • vor 6 Monaten