Loading video...

Video Failed to Load

Go Home

Still exploring the idea of controlling elements with real-time hand tracking, this time for something a little more fun > ShiFumMi ✂️✊✋ Built with Omma AI + ThreeJs

parazar's profile picture

Joseph Azar

2,533 subscribers

11,951 views • 2 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Built a pottery app today, where your real hands throw virtual clay 🏺 Hand tracking > clay deformation > real-time physics No controller. No stylus. Just hands. Everything built within Omma AI + threejs Model of the puppet hand: credit to LiamVandeWouwer (SketchFab)
0:23

Built a pottery app today, where your real hands throw virtual clay 🏺 Hand tracking > clay deformation > real-time physics No controller. No stylus. Just hands. Everything built within Omma AI + threejs Model of the puppet hand: credit to LiamVandeWouwer (SketchFab)

Joseph Azar

200,955 views • 2 months ago

Still experimenting with hand tracking 🖐️ using a webcam and the dear Carlo. The 3D model was generated from a single image in Omma AI Studio, and I remixed an Octopus demo to take advantage of the physics simulation. Building with AI these days is so much fun. Music also generated from the Studio (Fan Art) #threeJS
0:58

Still experimenting with hand tracking 🖐️ using a webcam and the dear Carlo. The 3D model was generated from a single image in Omma AI Studio, and I remixed an Octopus demo to take advantage of the physics simulation. Building with AI these days is so much fun. Music also generated from the Studio (Fan Art) #threeJS

Joseph Azar

74,357 views • 1 month ago

Update on my hand-tracking pottery app 🏺 New features just dropped: - Colorize your clay in real time - Change the shape of the clay base Got a webcam? Use your hands. Don't have one? Your mouse works just as well. Everything built within Omma + threeJs + mediaPipe Demo link in the comments 👇
0:35

Update on my hand-tracking pottery app 🏺 New features just dropped: - Colorize your clay in real time - Change the shape of the clay base Got a webcam? Use your hands. Don't have one? Your mouse works just as well. Everything built within Omma + threeJs + mediaPipe Demo link in the comments 👇

Joseph Azar

13,973 views • 2 months ago

Day 2! 🖐️ The hand tracking experiment in your browser keeps growing. Added a character gallery, Patrick and SpongeBob now stand alongside Squidward, along with their houses, a bubble particle system, and extra assets. Honestly, building with Omma AI right now is just too much fun. #threeJs
1:03

Day 2! 🖐️ The hand tracking experiment in your browser keeps growing. Added a character gallery, Patrick and SpongeBob now stand alongside Squidward, along with their houses, a bubble particle system, and extra assets. Honestly, building with Omma AI right now is just too much fun. #threeJs

Joseph Azar

36,050 views • 1 month ago

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.
0:12

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.

AA

19,435 views • 1 year ago

Search any location and millions of voxels reconstruct it in real-time.🤯All running inside a browser tab with WebGPU. Made with Omma AI, using Three.js.
0:34

Search any location and millions of voxels reconstruct it in real-time.🤯All running inside a browser tab with WebGPU. Made with Omma AI, using Three.js.

Gábor Pribék

20,146 views • 1 month ago

prototype of a recursive time helix calendar/history, with nested coils from centuries -> decades -> years -> days -> hours -> minutes -> seconds. labels need some work but it's the start of something. based almost entirely on Tim Babb 's sketch/idea. in threejs/webgpu
0:57

prototype of a recursive time helix calendar/history, with nested coils from centuries -> decades -> years -> days -> hours -> minutes -> seconds. labels need some work but it's the start of something. based almost entirely on Tim Babb 's sketch/idea. in threejs/webgpu

Codetaur

111,158 views • 4 months ago

The Live Globe is back on Sphere 100% live data, rendered in real-time, built with threejs, React, and a lot of shaders 3…2…1…
1:01

The Live Globe is back on Sphere 100% live data, rendered in real-time, built with threejs, React, and a lot of shaders 3…2…1…

tobi lutke

72,869 views • 8 months ago

Did a fun weekend coding project, a visual zone configurator with real-time tracking info for the Everything Presence Lite inside of Home Assistant What do you think, would this be useful?
0:32

Did a fun weekend coding project, a visual zone configurator with real-time tracking info for the Everything Presence Lite inside of Home Assistant What do you think, would this be useful?

Everything Smart Home

18,553 views • 1 year ago

Tired of waiting for the "New Siri" so I built it myself. Combining Google Gemini AI Live with WebGPU for a 3D-aware "Visual Intelligence" prototype. - Three.js for Apple Intelligence glow shader. - Depth-Anything Local ML for real-time 3D scanning effect. - Gemini Live for Multimodal voice + vision. Built with Omma AI. Lmk if you would like to try or remix! Anyone here planning to go to WWDC26?
0:20

Tired of waiting for the "New Siri" so I built it myself. Combining Google Gemini AI Live with WebGPU for a 3D-aware "Visual Intelligence" prototype. - Three.js for Apple Intelligence glow shader. - Depth-Anything Local ML for real-time 3D scanning effect. - Gemini Live for Multimodal voice + vision. Built with Omma AI. Lmk if you would like to try or remix! Anyone here planning to go to WWDC26?

Gábor Pribék

48,030 views • 3 months ago

Turn your playlist into a rhythm game. I built a fully procedural cartoon lowrider you control with a gamepad. Try to bounce, hop and lean in time with the music yourself. Turn on your audio 🔥 Built inside Omma AI with Three.js & Claude
0:57

Turn your playlist into a rhythm game. I built a fully procedural cartoon lowrider you control with a gamepad. Try to bounce, hop and lean in time with the music yourself. Turn on your audio 🔥 Built inside Omma AI with Three.js & Claude

Joseph Azar

21,464 views • 1 month ago

Experimenting with an idea I'm calling the sandbox. It's a little zone for the AI to create new UI elements that render in Conductor:
1:01

Experimenting with an idea I'm calling the sandbox. It's a little zone for the AI to create new UI elements that render in Conductor:

Charlie Holtz

27,946 views • 6 months ago

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇
0:49

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇

Stream

224,788 views • 1 year ago

making games in threejs is just too much fun. built games for brands with my amiga demoscene friends long time ago. now claude + codex whip up concepts in a weekend
0:58

making games in threejs is just too much fun. built games for brands with my amiga demoscene friends long time ago. now claude + codex whip up concepts in a weekend

taigajim

20,820 views • 8 days ago

Check out this guy wearing an Apple Vision using hand-tracking to control a robot in real time. Could this shift more jobs toward teleoperation in the future?
1:23

Check out this guy wearing an Apple Vision using hand-tracking to control a robot in real time. Could this shift more jobs toward teleoperation in the future?

Nathie

32,913 views • 1 year ago

Live link: Built to showcase what's possible with real-time WebGPU rendering using #threejs. Just a 6.3 MB download, yet the lighting looks baked—until you grab the sun and watch everything update in real time. I hope you like it 🤗
0:56

Live link: Built to showcase what's possible with real-time WebGPU rendering using #threejs. Just a 6.3 MB download, yet the lighting looks baked—until you grab the sun and watch everything update in real time. I hope you like it 🤗

Anderson Mancini

127,543 views • 22 days ago

expanding on my WebGPU motion tracking effect work this time with optical flow to visualize the motion of pixels as directional vectors in real time :)
0:21

expanding on my WebGPU motion tracking effect work this time with optical flow to visualize the motion of pixels as directional vectors in real time :)

Maxime

19,931 views • 1 month ago

built a smart parking system with Roboflow workflows. - license plate detection and ocr - object tracking with bytetrack. - counting cars entering and leaving the lot. - real-time alerts via telegram. link:
0:20

built a smart parking system with Roboflow workflows. - license plate detection and ocr - object tracking with bytetrack. - counting cars entering and leaving the lot. - real-time alerts via telegram. link:

SkalskiP

26,478 views • 1 year ago

THIS GUY BUILT REAL FLYING SWORD DRONES AND CONTROLS THEM WITH HAND GESTURES fan shisan is a physics student in chengdu who coded and built flying drones shaped like actual swords he controls them entirely with hand gestures. no controller or a phone. just his hands wave your hand and the sword follows. point and it flies where you direct it. multiple swords in the air at the same time responding to different gestures he built the gesture recognition system HIMSELF and coded the flight control algorithms. designed the drone hardware in the shape of swords. the gesture tracking uses sensors that read the position and movement of his hands in real time and translate them into flight commands for each drone independently he even built one large enough to ride on a physics student with coding skills just brought something straight out of a kung fu movie into the real world the line between science fiction and side projects is getting thinner every month
0:23

THIS GUY BUILT REAL FLYING SWORD DRONES AND CONTROLS THEM WITH HAND GESTURES fan shisan is a physics student in chengdu who coded and built flying drones shaped like actual swords he controls them entirely with hand gestures. no controller or a phone. just his hands wave your hand and the sword follows. point and it flies where you direct it. multiple swords in the air at the same time responding to different gestures he built the gesture recognition system HIMSELF and coded the flight control algorithms. designed the drone hardware in the shape of swords. the gesture tracking uses sensors that read the position and movement of his hands in real time and translate them into flight commands for each drone independently he even built one large enough to ride on a physics student with coding skills just brought something straight out of a kung fu movie into the real world the line between science fiction and side projects is getting thinner every month

Om Patel

307,609 views • 2 months ago

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.
0:54

Vidu S1, the World’s Most Advanced Model for Real-Time AI Interaction Vidu S1 introduces a new era of real-time interactive video. Voice-Driven Character Control: Go beyond voice-driven lip sync with real-time behavior generation. Characters understand, react, and respond naturally. Unlimited Real-Time Generation: Experience seamless real-time video generation with unlimited interaction duration. 540P at 25 FPS, built for live interaction: Generate video in real time at 540P / 25 FPS, with support for up to 42 FPS for even smoother experiences. Create Custom Characters from Images & Voices: Customize both appearance and voice. Bring humans, anime characters, pets, and more to life with personalized AI characters. Use code VIDUS1 to get started for free.

Vidu AI

1,533,081 views • 1 month ago