Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

i made an RPG inventory system where you point at objects to collect them irl built with roboflow RF-DETR object recognition, mediapipe hand tracking, and javascript (this runs live in the browser) collecting the apple gave me +10 hp

AA

25,560 subscribers

21,697 Aufrufe • vor 2 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

i gave a voice to my jarvis system everything running in real-time using open source models - roboflow RF-DETR for object detection - gemma 4 for scene summarization - kokoro text-to-speech - live in the browser using transformers js prompt: "you are a dystopian science fiction narrator in a cyberpunk world. describe the scene in one sentence"

i gave a voice to my jarvis system everything running in real-time using open source models - roboflow RF-DETR for object detection - gemma 4 for scene summarization - kokoro text-to-speech - live in the browser using transformers js prompt: "you are a dystopian science fiction narrator in a cyberpunk world. describe the scene in one sentence"

AA

28,753 Aufrufe • vor 4 Monaten

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2

i made a computer vision system to monitor the situation - live webcam feed and roboflow RF-DETR for object detection - inputs are fed into SmolVLM which describes what it sees in one sentence - dataviz with vanilla js all running locally in real-time on my macbook air m2

AA

72,555 Aufrufe • vor 5 Monaten

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this

i spent the afternoon experimenting with Gemma 4's vision capabilities made an app that uses roboflow RF-DETR for a first pass of object detections and Gemma to summarize the scene in one sentence for fun i asked Gemma to "describe what you see as if you were a medieval bard" all made with free local AI models (running via webgpu in the browser thanks to transformers js) lots more possibilities to explore with this

AA

701,048 Aufrufe • vor 4 Monaten

Today I created Tetris: but it has an unnecessary learning curve and makes my arm really tired 🟦🥵 Built with Three.js and MediaPipe hand-tracking. This runs on the web and uses a regular laptop / webcam. Let me know if you want to play, and I'll fight some bugs and ship! ⛴️

Today I created Tetris: but it has an unnecessary learning curve and makes my arm really tired 🟦🥵 Built with Three.js and MediaPipe hand-tracking. This runs on the web and uses a regular laptop / webcam. Let me know if you want to play, and I'll fight some bugs and ship! ⛴️

AA

20,114 Aufrufe • vor 1 Jahr

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples

i made a drum machine that turns hand gestures into drum loops and helps me create backing tracks while i'm playing piano it runs in the browser using my webcam; no special software or hardware created with Three.js, mediapipe computer vision, Kimi.ai k2.5 code, and some free drum samples

AA

18,605 Aufrufe • vor 6 Monaten

i made an app that turns videos into stop motion animations the beta is live!! send me a dm if you want to test it just takes 1 minute to animate a scene details: - it automatically extracts keyframes from a video and auto-edits into a stopmotion - uses computer vision magic (roboflow RF-DETR + custom code) to select stable frames and remove frames where your hands are showing - all processing happens locally on your iphone it's an early version with many improvements to come. let me know if you want an invite to test it

i made an app that turns videos into stop motion animations the beta is live!! send me a dm if you want to test it just takes 1 minute to animate a scene details: - it automatically extracts keyframes from a video and auto-edits into a stopmotion - uses computer vision magic (roboflow RF-DETR + custom code) to select stable frames and remove frames where your hands are showing - all processing happens locally on your iphone it's an early version with many improvements to come. let me know if you want an invite to test it

AA

30,413 Aufrufe • vor 1 Monat

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

planking for penguins 🐧 a real-time exercise tracking game, coded with Grok 4 (xAI) this uses mediapipe AI vision to detect when the player has proper plank form (knees-hips-shoulders in a horizontal line, elbows low) also using Three.js for visuals and tonejs for audio this all runs in real-time in the browser, using a regular laptop + webcam 🔗 live demo below

AA

244,071 Aufrufe • vor 1 Jahr

I finally implemented an inventory system where purchased parts can be stored disassembled without having to buy them again. This means you can have different turbo kits in the garage and choose the one that best suits the race for potential downgrades at no extra cost. It's a simple idea, but it's caused me a lot of headaches because I've had to make significant modifications to the system I had set up before. #SuperWodenGP3, Work in progress.

I finally implemented an inventory system where purchased parts can be stored disassembled without having to buy them again. This means you can have different turbo kits in the garage and choose the one that best suits the race for potential downgrades at no extra cost. It's a simple idea, but it's caused me a lot of headaches because I've had to make significant modifications to the system I had set up before. #SuperWodenGP3, Work in progress.

ViJuDa

11,166 Aufrufe • vor 1 Monat

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.

In their latest video, Boston Dynamics’s AI team explains how they make the Atlas humanoid perceive and interact with the world. Atlas uses an agile perception system to understand both the shape and context of objects in complex environments. Atlas combines 2D and 3D awareness, keypoint-based localization, and an object pose tracking system that fuses vision, kinematics, and object knowledge to handle occlusion and uncertainty. Accurate calibration ensures precise hand–eye coordination for reliable manipulation. The team is now working toward a unified model that merges perception and control – pushing beyond spatial AI toward physical intelligence.

The Humanoid Hub

50,083 Aufrufe • vor 1 Jahr

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

Binh Pham

121,383 Aufrufe • vor 1 Monat

This is the latest Google research on XR Interaction: World Mouse. Instead of using hand rays or gestures to point at things in the physical space, you move a cursor with a mouse and the system figures out where that cursor should sit in the 3D world. It works in two main ways: - On an object, the cursor follows the surface, so you can move precisely across walls, screens, furniture, or virtual objects. - Between objects, the system creates a smooth bridge through space, so the cursor can travel from one surface to another. That means you can go from a 2D panel to a 3D object, place content on a real wall, manipulate virtual objects, or interact with physical devices through digital proxies. This is the type of news, tools and product updates I share weekly in my newsletter. If you are into 3D XR and AI make sure to check it out (link on top of my profile). Based on “World Mouse: Exploring Interactions with a Cross-Reality Cursor” by Esen K. Tütüncü, Mar Gonzalez-Franco, Khushman Patel, and Eric J. Gonzalez

Gabriele Romagnoli

28,945 Aufrufe • vor 4 Monaten

I built this little tool to optimize and re-export GLTF/GLB assets to GPU-compressed KTX2. It runs entirely client-side/in-browser. You can fiddle with the parameters, compare the before/after, and export to GLB. Try it here: #threejs #gamedev

I built this little tool to optimize and re-export GLTF/GLB assets to GPU-compressed KTX2. It runs entirely client-side/in-browser. You can fiddle with the parameters, compare the before/after, and export to GLB. Try it here: #threejs #gamedev

Simon

24,265 Aufrufe • vor 8 Monaten

Wouldn't it be cool to interact with real objects in #MixedReality? For instance, doing a simple action like pouring water into your glass and making it become magical with augmentations? I think it would and that's why I made an opensource Unity plugin to make it happen. Currently, mixed reality headsets do not offer object tracking and we have no camera access to implement it ourselves. But I had an idea: since we interact with objects with our hands, why can't we just track the hands to infer the pose of the object we are holding? I tried to carry on this idea and after a few weeks,open-sourceand fully I came up with this opensource plugin that lets you do exactly this. It is an alpha, it has a lot of problems, also because the tracking of the hands becomes a bit glitchy when you are holding an object, but you can already do nice things with it. And it's full opensource and cross-platform (I used AR Foundation), so you can have fun with it however you want. It's a gift I give to the community. You can see the full video of the animation, with the explanation of what I did behind the curtains, at this link: The article I wrote on my blog about it is available instead here: If you want to play around with the repository of the plugin, you have to go to this page: I hope to have inspired you a bit... let me know what your thoughts are! #VirtualReality #metaverse #gamedev #unity #unity3d

Wouldn't it be cool to interact with real objects in #MixedReality? For instance, doing a simple action like pouring water into your glass and making it become magical with augmentations? I think it would and that's why I made an opensource Unity plugin to make it happen. Currently, mixed reality headsets do not offer object tracking and we have no camera access to implement it ourselves. But I had an idea: since we interact with objects with our hands, why can't we just track the hands to infer the pose of the object we are holding? I tried to carry on this idea and after a few weeks,open-sourceand fully I came up with this opensource plugin that lets you do exactly this. It is an alpha, it has a lot of problems, also because the tracking of the hands becomes a bit glitchy when you are holding an object, but you can already do nice things with it. And it's full opensource and cross-platform (I used AR Foundation), so you can have fun with it however you want. It's a gift I give to the community. You can see the full video of the animation, with the explanation of what I did behind the curtains, at this link: The article I wrote on my blog about it is available instead here: If you want to play around with the repository of the plugin, you have to go to this page: I hope to have inspired you a bit... let me know what your thoughts are! #VirtualReality #metaverse #gamedev #unity #unity3d

TonyVT SkarredGhost

20,878 Aufrufe • vor 2 Jahren

I made a Dark Souls-inspired Three.js game with Sol Ultra using Codex Sites. It's fully playable in the browser. I handled the prompts, references, and libraries like img2threejs. The game has shield blocking, dodge rolls, archery, and a full inventory system. Still blows my mind that you can build a 3D game like this in a single afternoon.

I made a Dark Souls-inspired Three.js game with Sol Ultra using Codex Sites. It's fully playable in the browser. I handled the prompts, references, and libraries like img2threejs. The game has shield blocking, dodge rolls, archery, and a full inventory system. Still blows my mind that you can build a 3D game like this in a single afternoon.

Meng To

169,311 Aufrufe • vor 24 Tagen

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally through the model, and identifies objects in real-time. we are entering an era where you can just glue intelligence onto any physical object for less than $10. the hardware barrier is completely shattered.

another example: a developer used the exact same $8 ESP32-S3 chip and local AI setup to build a real-time object recognition camera the fact that this is running entirely offline, on an eight-dollar microcontroller, without any cloud API calls, is wild... it captures the video feed, processes it locally through the model, and identifies objects in real-time. we are entering an era where you can just glue intelligence onto any physical object for less than $10. the hardware barrier is completely shattered.

ard

222,725 Aufrufe • vor 22 Tagen

"This is home for me. This is the organization that gave me an opportunity to live out my dream. This is where I want to be and this is the group that I want to help in whatever fashion win hockey games." - Chris Kreider

"This is home for me. This is the organization that gave me an opportunity to live out my dream. This is where I want to be and this is the group that I want to help in whatever fashion win hockey games." - Chris Kreider

Rangers Videos

55,020 Aufrufe • vor 1 Jahr

When Lloyd made partner at Goldman, a senior partner gave him the rules of the road. The one that stuck: "Live a life where your obituary runs nine paragraphs. And make sure no more than three of them are about Goldman." His take now: "That's not going to be the case for me. I stayed too long."

When Lloyd made partner at Goldman, a senior partner gave him the rules of the road. The one that stuck: "Live a life where your obituary runs nine paragraphs. And make sure no more than three of them are about Goldman." His take now: "That's not going to be the case for me. I stayed too long."

Sam Parr

376,508 Aufrufe • vor 1 Monat

SHE CHARGES $7500 FOR A SITE YOU CONTROL BY WAVING AT YOUR WEBCAM no mouse, no scroll, no clicking anything, the camera tracks your hand and the whole site responds as you move it through the air how she built it: render the base clip in seedance 2 open replit and attach your design reference tell it to wire hand tracking with mediapipe map the hand position to the video in a single prompt still in the same chat, switch it to slide mode or a scroll transform whenever you want she never wrote one line of the tracking code, replit stood up the entire gesture layer from that one instruction meanwhile your local dev still thinks interactive means a button that lights up when the cursor grazes it the exact mediapipe prompt is in the guide below, save it before this becomes the standard

SHE CHARGES $7500 FOR A SITE YOU CONTROL BY WAVING AT YOUR WEBCAM no mouse, no scroll, no clicking anything, the camera tracks your hand and the whole site responds as you move it through the air how she built it: render the base clip in seedance 2 open replit and attach your design reference tell it to wire hand tracking with mediapipe map the hand position to the video in a single prompt still in the same chat, switch it to slide mode or a scroll transform whenever you want she never wrote one line of the tracking code, replit stood up the entire gesture layer from that one instruction meanwhile your local dev still thinks interactive means a button that lights up when the cursor grazes it the exact mediapipe prompt is in the guide below, save it before this becomes the standard

Bounce

59,536 Aufrufe • vor 1 Monat