Loading video...

Video Failed to Load

Go Home

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

BrilliantSole's profile picture

Brilliant Wear

1,588 subscribers

18,572 views • 7 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)
0:30

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

Brilliant Wear

79,540 views • 7 months ago

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu
0:46

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Brilliant Wear

65,083 views • 7 months ago

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data
1:13

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Brilliant Wear

14,800 views • 4 months ago

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware
0:57

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

Brilliant Wear

13,437 views • 4 months ago

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)
0:26

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 views • 9 months ago

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures
0:24

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Brilliant Wear

29,397 views • 10 months ago

🤖 What if a tiny desk rover could explore autonomously? Amit built LUN-E Explorer with our XIAO ESP32-S3 Sense, streaming live camera frames to a local webpage at explorer.local. The browser analyzes the floor, objects, motion, and cliffs, then sends motor commands back over Wi-Fi. Check it out 👉
1:47

🤖 What if a tiny desk rover could explore autonomously? Amit built LUN-E Explorer with our XIAO ESP32-S3 Sense, streaming live camera frames to a local webpage at explorer.local. The browser analyzes the floor, objects, motion, and cliffs, then sends motor commands back over Wi-Fi. Check it out 👉

Seeed Studio

11,690 views • 2 months ago

Stomp, Kick, and Toss green shells in WebXR on the Quest 3 A-Frame By strapping our Ukaton modules to our ankle, we can detect kicks and stomps by running an Edge Impulse model on-device, and then send the results to the headset via WebSockets We also add haptic feedback by vibrating the models when kicking or stomping, creating a more immersive experience
1:08

Stomp, Kick, and Toss green shells in WebXR on the Quest 3 A-Frame By strapping our Ukaton modules to our ankle, we can detect kicks and stomps by running an Edge Impulse model on-device, and then send the results to the headset via WebSockets We also add haptic feedback by vibrating the models when kicking or stomping, creating a more immersive experience

BrilliantSole

13,027 views • 1 year ago

Meta Quest 3 users can beta test at in the Meta Quest 3 Browser - its a #WebXR #threejs webpage so no installs needed. Let me know how you get on! 👾 #MetaQuest3 #MixedReality
0:37

Meta Quest 3 users can beta test at in the Meta Quest 3 Browser - its a #WebXR #threejs webpage so no installs needed. Let me know how you get on! 👾 #MetaQuest3 #MixedReality

Dominic Pajak

73,054 views • 2 years ago

Few know this yet, but Hyperfy has built an insanely well-performing WebXR engine. 🔹 Almost 100Hz feel on my Quest 3 🔹 Runs buttery smooth in a browser, standalone 🔹 Even screen recording doesn’t cause noticeable frame drops Hard to believe this is WebXR. Three.js #WebXR 🔗 Link to try it yourself in the comments!
1:13

Few know this yet, but Hyperfy has built an insanely well-performing WebXR engine. 🔹 Almost 100Hz feel on my Quest 3 🔹 Runs buttery smooth in a browser, standalone 🔹 Even screen recording doesn’t cause noticeable frame drops Hard to believe this is WebXR. Three.js #WebXR 🔗 Link to try it yourself in the comments!

𝚟𝚘𝚡𝚟𝚒𝚎𝚗𝚗𝚎

19,750 views • 1 year ago

Custom water shader with waterline and underwater effects in Unity, URP. Running natively on Quest 3 at 72fps. No post-processing. The waterline and underwater fogs are just two quads in front of the camera with special shaders. #unity #madewithunity #quest #vr #MetaQuest3
0:43

Custom water shader with waterline and underwater effects in Unity, URP. Running natively on Quest 3 at 72fps. No post-processing. The waterline and underwater fogs are just two quads in front of the camera with special shaders. #unity #madewithunity #quest #vr #MetaQuest3

Shahzod Boyhonov

70,901 views • 2 years ago

If you got a Quest 3 at launch, give browser-based MR a try with Spatial Fusion - the WebXR experience that I worked on with PHORIA & Lusion™ for Meta! For web devs; mixed-reality on the web has really crossed a threshold in the last year!
0:53

If you got a Quest 3 at launch, give browser-based MR a try with Spatial Fusion - the WebXR experience that I worked on with PHORIA & Lusion™ for Meta! For web devs; mixed-reality on the web has really crossed a threshold in the last year!

Ben Ferns

22,840 views • 2 years ago

🚵 I've been working on this for quite some time. Wanted to explore if it's possible to watch cycling in AR (Quest 3 and AVP). Tried it with the Ronde Van Vlaanderen but was not able to gather enough data. With the Tour De France I was able to create this POC #webxr #TourdeFrance
2:14

🚵 I've been working on this for quite some time. Wanted to explore if it's possible to watch cycling in AR (Quest 3 and AVP). Tried it with the Ronde Van Vlaanderen but was not able to gather enough data. With the Tour De France I was able to create this POC #webxr #TourdeFrance

Stijn Spanhove

34,343 views • 2 years ago

Time to update my Quest MR + Gen AI prototype now that Meta Quest Camera API is out — This proto is using a workaround to capture passthrough snapshots, processes them with Stable Diffusion, and displays the results back in their exact physical location. #MR #AI
2:16

Time to update my Quest MR + Gen AI prototype now that Meta Quest Camera API is out — This proto is using a workaround to capture passthrough snapshots, processes them with Stable Diffusion, and displays the results back in their exact physical location. #MR #AI

Hugues Bruyère

11,744 views • 1 year ago

I bought a VeVe | Digital Collectibles collectible using $OMI 0:11 Why this video matters 0:51 Bridging $OMI with StackR 1:26 Omillionaire 2:00 My 1st ever OMI to NFT 2:45 Final thoughts on ECOMI | $OMI ⭕️ 3:13 Would love to hear your take Full video here if you want to see the process
3:31

I bought a VeVe | Digital Collectibles collectible using $OMI 0:11 Why this video matters 0:51 Bridging $OMI with StackR 1:26 Omillionaire 2:00 My 1st ever OMI to NFT 2:45 Final thoughts on ECOMI | $OMI ⭕️ 3:13 Would love to hear your take Full video here if you want to see the process

Chris ☕️

24,176 views • 1 year ago

AR Violin on the Quest Pro 🎻 #WebXR A-Frame Instead of using AR to assist me playing a real violin, I used polycam to 3D scan the violin & bow, and used a violin #Tonejs instrument Each finger maps to each string, and the more I curl them the higher the note
0:51

AR Violin on the Quest Pro 🎻 #WebXR A-Frame Instead of using AR to assist me playing a real violin, I used polycam to 3D scan the violin & bow, and used a violin #Tonejs instrument Each finger maps to each string, and the more I curl them the higher the note

Ukaton

81,165 views • 3 years ago

🔥 We fine-tuned Gemma 3 using Unsloth AI on a custom instruction dataset scraped and built with . The model is now able to answer questions about OpenAI Agents SDK documentation. Check out the demo below👇
0:48

🔥 We fine-tuned Gemma 3 using Unsloth AI on a custom instruction dataset scraped and built with . The model is now able to answer questions about OpenAI Agents SDK documentation. Check out the demo below👇

Eric Ciarla (hiring)

28,794 views • 1 year ago

🎁Quest Master - Steam Key Giveaway! To celebrate the release of the new Gustwind Palace theme I'll be giving away 3 Quest Master Steam Keys. To enter: - Follow Quest Master - Like & Retweet - Tag a Friend! ⌛️Ends in 3 days, I'll tag the winners! LOVE YOU💚
1:10

🎁Quest Master - Steam Key Giveaway! To celebrate the release of the new Gustwind Palace theme I'll be giving away 3 Quest Master Steam Keys. To enter: - Follow Quest Master - Like & Retweet - Tag a Friend! ⌛️Ends in 3 days, I'll tag the winners! LOVE YOU💚

Tommy

15,402 views • 2 years ago

A Small Guide on how to Fight Tornado and Complete the Quest "A Breeze through the Cage" > Easiest way to get arrested 1 star and Enter the Police Station > In this quest you fight Tornado (Name Change Once the Quest ends) > Unlock 3 difficulty levels for PVE Content! #NTE
2:07

A Small Guide on how to Fight Tornado and Complete the Quest "A Breeze through the Cage" > Easiest way to get arrested 1 star and Enter the Police Station > In this quest you fight Tornado (Name Change Once the Quest ends) > Unlock 3 difficulty levels for PVE Content! #NTE

Fan | NTE Info

21,288 views • 1 month ago