Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on...

BrilliantSole's profile picture

Brilliant Wear

1,597 subscribers

79,410 Aufrufe • vor 6 Monaten •via X (Twitter)

Gesundheit & WellnessBildungWissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser
0:45

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Brilliant Wear

18,473 Aufrufe • vor 6 Monaten

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data
1:13

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Brilliant Wear

14,800 Aufrufe • vor 4 Monaten

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware
0:57

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

Brilliant Wear

13,290 Aufrufe • vor 4 Monaten

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu
0:46

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Brilliant Wear

64,936 Aufrufe • vor 6 Monaten

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
0:26

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 Aufrufe • vor 9 Monaten

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures
0:24

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Brilliant Wear

29,397 Aufrufe • vor 9 Monaten

We're running 500 neural nets in parallel to pull this one off. We make smart glasses for the deaf and just hit a breakthrough: Real world audio event notifications on smart glasses. Laughter, speech, doorbell, phone ring, etc. on smart glasses for the deaf.
0:29

We're running 500 neural nets in parallel to pull this one off. We make smart glasses for the deaf and just hit a breakthrough: Real world audio event notifications on smart glasses. Laughter, speech, doorbell, phone ring, etc. on smart glasses for the deaf.

cayden 凯登

26,614 Aufrufe • vor 1 Jahr

Streaming HD video from smart glasses camera for >1 hour is hard But if someone cracked it, they'd unlock smart glasses for streamers, manufacturing, retail, etc. We cracked it. Mentra Live with micro-charge cable can stream... Forever
0:35

Streaming HD video from smart glasses camera for >1 hour is hard But if someone cracked it, they'd unlock smart glasses for streamers, manufacturing, retail, etc. We cracked it. Mentra Live with micro-charge cable can stream... Forever

cayden 凯登

66,566 Aufrufe • vor 9 Monaten

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)
0:25

Smart glasses see what workers do So robots can learn to do the same work On Mentra smart glasses, we did this in a Shenzhen smartwatch factory But everything changes once you feed that live glasses audio/video to AI And let the AI whisper back assistance in workers ears ;)

cayden 凯登

33,256 Aufrufe • vor 1 Jahr

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?
13:19

We put 1000s of hours into building open-source camera glasses And now we're giving away everything we learned for free. Checkout this in-depth teardown of the Mentra Live smart glasses. As an OS company, our goal is to spread our OS. That goal encourages us to do crazy things, like build the world's best AI glasses for business and then show you how we made them... all in the name of spreading the OS. It also convinced us to make it 100% open source, so adoption is faster and easier. We're at risk of our competitors easily copypasting our code now... all in the name of spreading our OS. Now we've built the glasses for you, and we've taken the risk, and we've released an open SDK. Now your AI apps and agents can enter the real world on smart glasses. So now, what will you build?

cayden 凯登

20,387 Aufrufe • vor 1 Monat

Calorie tracking smart glasses
0:37

Calorie tracking smart glasses

cayden 凯登

12,717 Aufrufe • vor 11 Monaten

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.
2:25

JUST IN: Google unveiled its smart glasses project with XREAL, called Project Aura. • 70° FOV for a giant virtual screen anywhere • run full Android apps in floating windows • Circle to Search on anything you look at • lightweight frame powered by a small compute puck • hand tracking for pinch, zoom and window control Launching in 2026.

Ritwik Pavan

259,629 Aufrufe • vor 7 Monaten

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.
0:12

which tutorial (+code) should I release next? > Left: 3D graph data viz > Right: Severance game projects are built with Three.js and mediapipe AI vision learn how to build real-time hand tracking apps for 3D design, games, etc.

AA

19,435 Aufrufe • vor 1 Jahr

The quicker we utilize our knowledge and understanding our resources we shall come to the Conclusion that the Democratic Party works hand in hand with Violent Extremism Groups such as Antifa, BLM and Pro Palestine (Hamas). Then we can Focus on Dismantling it!
1:21

The quicker we utilize our knowledge and understanding our resources we shall come to the Conclusion that the Democratic Party works hand in hand with Violent Extremism Groups such as Antifa, BLM and Pro Palestine (Hamas). Then we can Focus on Dismantling it!

Johnny Midnight ⚡️

50,346 Aufrufe • vor 1 Jahr

Google's back in the glasses game, with the reveal of Android XR smart glasses at #GoogleIO. This marks our best look yet at what their collaboration with Samsung, Warby Parker and Gentle Monster looks like, with a focus on vocal interactions with Gemini as a companion to your phone, which you can watch in this demo 🕶️
1:46

Google's back in the glasses game, with the reveal of Android XR smart glasses at #GoogleIO. This marks our best look yet at what their collaboration with Samsung, Warby Parker and Gentle Monster looks like, with a focus on vocal interactions with Gemini as a companion to your phone, which you can watch in this demo 🕶️

TechCrunch

64,128 Aufrufe • vor 1 Monat

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.
2:27

Launching full support for Even Realities G2 smart glasses in MentraOS. With Mentra, you can run multiple smart glasses apps at once. You: in a meeting in Tokyo on 82nd floor. You're running translation on your smart glasses and understanding every word. Your Notetaker is running in the background capturing ideas as they're spoken. Your proactive AI agent is listening in, hears someone ask a question, and automatically overlays the answer on your vision. That's what's Mentra unlocks. MentraOS is the open source OS for smart glasses. We give users an app store and allow developers to write one app that runs on any pair of smart glasses. It's 100% open source, private, and free. How to use: Download the Mentra app, connect your G2, and get instant access to captions, AI notetaker, Merge proactive AI, translation, and other apps. You can switch back to the Even app at anytime. If you want to unlock your Even G2, then downalod Mentra on the Google or Apple App Store.

cayden 凯登

38,419 Aufrufe • vor 1 Monat

Introducing the Mentra Bluetooth SDK - control smart glasses directly from your Android/iOS app. Thousands of devs built smart glasses apps. But we heard one common complaint.... the cloud. So we stripped it out and gave you direct glasses control straight from your phone app.
1:47

Introducing the Mentra Bluetooth SDK - control smart glasses directly from your Android/iOS app. Thousands of devs built smart glasses apps. But we heard one common complaint.... the cloud. So we stripped it out and gave you direct glasses control straight from your phone app.

cayden 凯登

13,092 Aufrufe • vor 1 Monat

AI agents need context. Smart glasses give you all the context I'm streaming HD video from my glasses And they stream everywhere. X, your app, OnlyFans, etc With open-source SDK so you can build stuff like calorie counter, super memory, "Her", etc.
0:26

AI agents need context. Smart glasses give you all the context I'm streaming HD video from my glasses And they stream everywhere. X, your app, OnlyFans, etc With open-source SDK so you can build stuff like calorie counter, super memory, "Her", etc.

cayden 凯登

39,021 Aufrufe • vor 8 Monaten