Brilliant Wear's banner

Brilliant Wear

@BrilliantSole • 1,596 subscribers

The Unified Platform for Wearable Intelligence. XR Glasses & wearables full stack. Brilliant Sole insoles, and Brilliant Sense sensing & haptics devices.

Shorts

Detect head gestures with smart glasses Used Edge Impulse to create a simple classifier to detect head gestures (nod and shake) based on motion data, all running on the glasses itself via Tensorflow lite Using the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense) running our custom firmware

Detect head gestures with smart glasses Used Edge Impulse to create a simple classifier to detect head gestures (nod and shake) based on motion data, all running on the glasses itself via Tensorflow lite Using the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense) running our custom firmware

85,328 次观看

Local AI Assistant on Smart Glasses Using our Wearables SDK to take a picture, ask a question with Whisper’s speech to text, and use Chrome’s Prompt API (powered by Gemini Nano) to generate a response, displaying the results back on the glasses’ display Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Local AI Assistant on Smart Glasses Using our Wearables SDK to take a picture, ask a question with Whisper’s speech to text, and use Chrome’s Prompt API (powered by Gemini Nano) to generate a response, displaying the results back on the glasses’ display Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

49,490 次观看

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

Made a Unity SDK for our smart insoles Scan for, connect to, and receive sensor data from our insoles via Bluetooth

Made a Unity SDK for our smart insoles Scan for, connect to, and receive sensor data from our insoles via Bluetooth

492,629 次观看 • 1 年前

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

79,358 次观看 • 5 个月前

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

64,936 次观看 • 5 个月前

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

53,763 次观看 • 7 个月前

Using our smart insoles as foot trackers in VRChat With our OSC server we can stream motion and pressure data into #VRChat *Our insoles are 3DoF (just orientation, no position) We fixed the feet to the ground for demonstration, but they’re best used alongside other trackers Special thanks to Duinrahaic for helping out with debugging

Using our smart insoles as foot trackers in VRChat With our OSC server we can stream motion and pressure data into #VRChat *Our insoles are 3DoF (just orientation, no position) We fixed the feet to the ground for demonstration, but they’re best used alongside other trackers Special thanks to Duinrahaic for helping out with debugging

111,630 次观看 • 1 年前

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

14,800 次观看 • 2 个月前

Created a Swift Package for our Smart Insoles, along with a sample SwiftUI app It even works directly in Xcode Previews Works on iOS, macOS, watchOS, visionOS, and tvOS

Created a Swift Package for our Smart Insoles, along with a sample SwiftUI app It even works directly in Xcode Previews Works on iOS, macOS, watchOS, visionOS, and tvOS

50,947 次观看 • 1 年前

Connecting an Apple Watch to our Smart Insoles Using our Brilliant Sole Swift Package in a SwiftUI app Get sensor data, trigger haptics, and even send ML models to the insoles It also works in Xcode Previews (Core Bluetooth doesn’t work on non-MacOS schemes, but you can use our nodejs server to relay sensor data over UDP, which surprisingly works in the WatchOS simulator but not on the watch itself)

Connecting an Apple Watch to our Smart Insoles Using our Brilliant Sole Swift Package in a SwiftUI app Get sensor data, trigger haptics, and even send ML models to the insoles It also works in Xcode Previews (Core Bluetooth doesn’t work on non-MacOS schemes, but you can use our nodejs server to relay sensor data over UDP, which surprisingly works in the WatchOS simulator but not on the watch itself)

46,316 次观看 • 1 年前

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

29,397 次观看 • 8 个月前

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

13,239 次观看 • 2 个月前

Gaze-based Music Composition 🎶 🎹 👀 With the Quest Pro’s eye tracking, we can plot notes anywhere in time by simply looking and playing keys on a midi keyboard We also use our Smart Insoles to switch to “Hover Play” mode, playing the notes as we look at them, literally “reading” the music Can you guess what the theme is?

Gaze-based Music Composition 🎶 🎹 👀 With the Quest Pro’s eye tracking, we can plot notes anywhere in time by simply looking and playing keys on a midi keyboard We also use our Smart Insoles to switch to “Hover Play” mode, playing the notes as we look at them, literally “reading” the music Can you guess what the theme is?

43,049 次观看 • 1 年前

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

18,440 次观看 • 5 个月前

Connecting our smart insoles to an Apple Vision Pro (simulator) using our Swift package + SwiftUI sample app The AVP simulator doesn’t have Bluetooth enabled, but fortunately our nodejs server can relay data via UDP Even works in Xcode previews - great for iterating (even if you do have an AVP system on hand)

Connecting our smart insoles to an Apple Vision Pro (simulator) using our Swift package + SwiftUI sample app The AVP simulator doesn’t have Bluetooth enabled, but fortunately our nodejs server can relay data via UDP Even works in Xcode previews - great for iterating (even if you do have an AVP system on hand)

29,372 次观看 • 1 年前

Visualizing smart insole data on iOS with a SwiftUI app using our Swift package Get sensor data, and even upload Tflite files for on-device machine learning (eg custom gesture recognition) Even works in Xcode Previews using our nodejs server to relay Bluetooth data via UDP (core Bluetooth only works on MacOS schemes for Xcode previews) We also included a sample Battery Level widget (watch til the end) I’ll be in sf this week for GDC - dm me if you wanna meet up

Visualizing smart insole data on iOS with a SwiftUI app using our Swift package Get sensor data, and even upload Tflite files for on-device machine learning (eg custom gesture recognition) Even works in Xcode Previews using our nodejs server to relay Bluetooth data via UDP (core Bluetooth only works on MacOS schemes for Xcode previews) We also included a sample Battery Level widget (watch til the end) I’ll be in sf this week for GDC - dm me if you wanna meet up

18,777 次观看 • 1 年前

Stomp, Kick, and Toss green shells in WebXR on the Quest 3 A-Frame By strapping our Ukaton modules to our ankle, we can detect kicks and stomps by running an Edge Impulse model on-device, and then send the results to the headset via WebSockets We also add haptic feedback by vibrating the models when kicking or stomping, creating a more immersive experience

Stomp, Kick, and Toss green shells in WebXR on the Quest 3 A-Frame By strapping our Ukaton modules to our ankle, we can detect kicks and stomps by running an Edge Impulse model on-device, and then send the results to the headset via WebSockets We also add haptic feedback by vibrating the models when kicking or stomping, creating a more immersive experience

13,027 次观看 • 1 年前

Using TapWithUs’s TapXR to navigate the Smart Insole demos we’ve made for the Brilliant Labs Frame 👓 Wearable input devices like TapXR, Doublepoint and Augmental are great companion devices when navigating Smart Glasses applications

Using TapWithUs’s TapXR to navigate the Smart Insole demos we’ve made for the Brilliant Labs Frame 👓 Wearable input devices like TapXR, Doublepoint and Augmental are great companion devices when navigating Smart Glasses applications

13,229 次观看 • 1 年前

没有更多内容可加载