Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on... show more

Brilliant Wear

1,588 subscribers

79,540 views • 7 months ago •via X (Twitter)

Health & Wellness Education Science & Technology

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Brilliant Wear

18,572 views • 6 months ago

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Brilliant Wear

14,800 views • 4 months ago

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

Brilliant Wear

13,437 views • 4 months ago

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Brilliant Wear

65,083 views • 7 months ago

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 views • 9 months ago

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Brilliant Wear

29,397 views • 10 months ago

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

cayden 凯登

33,256 views • 1 year ago

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?

cayden 凯登

20,460 views • 2 months ago

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.

Ritwik Pavan

260,244 views • 7 months ago

The quicker we utilize our knowledge and understanding our resources we shall come to the Conclusion that the Democratic Party works hand in hand with Violent Extremism Groups such as Antifa, BLM and Pro Palestine (Hamas). Then we can Focus on Dismantling it!

The quicker we utilize our knowledge and understanding our resources we shall come to the Conclusion that the Democratic Party works hand in hand with Violent Extremism Groups such as Antifa, BLM and Pro Palestine (Hamas). Then we can Focus on Dismantling it!

Johnny Midnight ⚡️

50,346 views • 1 year ago

Google's back in the glasses game, with the reveal of Android XR smart glasses at #GoogleIO. This marks our best look yet at what their collaboration with Samsung, Warby Parker and Gentle Monster looks like, with a focus on vocal interactions with Gemini as a companion to your phone, which you can watch in this demo 🕶️

Google's back in the glasses game, with the reveal of Android XR smart glasses at #GoogleIO. This marks our best look yet at what their collaboration with Samsung, Warby Parker and Gentle Monster looks like, with a focus on vocal interactions with Gemini as a companion to your phone, which you can watch in this demo 🕶️

TechCrunch

64,151 views • 2 months ago

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.

cayden 凯登

38,419 views • 2 months ago

Most of today's AI can see the world, but it doesn’t **feel** it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Most of today's AI can see the world, but it doesn’t feel it. Capturing the sense of touch is crucial for dexterous robotic manipulation, user modeling, and understanding physical interactions. Introducing OpenTouch: bringing full-hand tactile sensing into real-world AI🖐️ OpenTouch is collected in-the-wild using tactile sensing gloves, hand pose tracking gloves, and egocentric glasses. It includes: • 5 hours of real-world data, • 3 hours densely annotated contact-rich interactions, • 2,900 curated interaction clips, • across 800 objects, 14 environments, and 29 grasp types. all open at:

Paul Liang

47,158 views • 3 months ago

Using our smart insoles as foot trackers in VRChat With our OSC server we can stream motion and pressure data into #VRChat *Our insoles are 3DoF (just orientation, no position) We fixed the feet to the ground for demonstration, but they’re best used alongside other trackers Special thanks to Duinrahaic for helping out with debugging

Using our smart insoles as foot trackers in VRChat With our OSC server we can stream motion and pressure data into #VRChat *Our insoles are 3DoF (just orientation, no position) We fixed the feet to the ground for demonstration, but they’re best used alongside other trackers Special thanks to Duinrahaic for helping out with debugging

Brilliant Wear

111,764 views • 1 year ago

The Easiest-to-Use VTuber App! We have released Version 1.11.2✨ You can download the latest version for free! [Key Updates] ✅Improved hand & finger tracking ✅New Camera/Light Tools in 3D Background ✅Screenshots save with transparency ...and more!

The Easiest-to-Use VTuber App! We have released Version 1.11.2✨ You can download the latest version for free! [Key Updates] ✅Improved hand & finger tracking ✅New Camera/Light Tools in 3D Background ✅Screenshots save with transparency ...and more!

Webcam Motion Capture

97,593 views • 4 months ago

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."

Bloomberg's Mark Gurman on the recent investigation alleging that Meta subcontractors reviewed video captured by customers’ smart glasses, including highly sensitive material: "I think it raises really big questions about the smart glasses category." "This is reminiscent of when people figured out that Apple with Siri... had these folks called annotation analysts who listen to everything you're putting into the voice assistant." "[The Meta allegations don't concern] audio. This is camera footage. This is people potentially in intimate moments. I think that raises really big questions about the smart glasses category..." "At the same time, I don't think this changes the overall equation for smart glasses. I still think that this has been a successful pioneering product for Meta. In this case, with the smart glasses, the first-mover advantage is real."

TBPN

17,035 views • 5 months ago

Humane AI Pin and Rabbit R1 failed, but why? I tried 17 AI Wearables from glasses to pins to pendants, here's the problem I found:- > Form Factor - It is lot of effort for brain and body to learn to add new form factors(glasses, pins on chest) in lifestyle > Missing integration to ecosystem, thus not solving a pain point > Smart glasses put strain on eyes and we humans are not designed to put screen on eyeballs 6-8 hours/day. Since I have moved to SF (so called tech bubble), haven't met a single person who uses smart glasses or wearable everyday especially in homespace and workspace. What are your thoughts?

Humane AI Pin and Rabbit R1 failed, but why? I tried 17 AI Wearables from glasses to pins to pendants, here's the problem I found:- > Form Factor - It is lot of effort for brain and body to learn to add new form factors(glasses, pins on chest) in lifestyle > Missing integration to ecosystem, thus not solving a pain point > Smart glasses put strain on eyes and we humans are not designed to put screen on eyeballs 6-8 hours/day. Since I have moved to SF (so called tech bubble), haven't met a single person who uses smart glasses or wearable everyday especially in homespace and workspace. What are your thoughts?

Ishika Mittal

24,820 views • 2 months ago