正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

VPS tracking on smart glasses Experimenting with MultiSet AI’s Visual Positioning System (VPS) to determine a person’s position relative to a 3d scanned environment, using just an image Works with compatible smartglasses, in this case Omi AI’s Omi Glass (based on Seeed Studio’s ESP32-S3 Sense) running our custom firmware

Brilliant Wear

1,573 subscribers

13,631 次观看 • 7 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

1 条评论

LokeshArt 的头像

LokeshArt6 个月前

@multiset_ai @omidotme Hi how can I build this is there any tutorial

相关视频

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Positional tracking on smart glasses and webcams Experimenting with Niantic Spatial 🌎’s 8th Wall engine to get position using camera and motion data Works with compatible smartglasses, in this case a modified Omi AI’s Omi Glass (based on the Seeed Studio ESP32-S3 Sense) running custom firmware Also works on webcams using our motion modules for supplying imu data

Brilliant Wear

15,169 次观看 • 7 个月前

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)

Brilliant Wear

80,010 次观看 • 10 个月前

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Streaming Smart Glasses Camera to a Quest 3 in WebXR A-Frame Using our Wearables SDK, we’re able to stream camera data from the Omi AI Omi Glass (based on the Seeed Studio XIAO ESP32-S3 Sense running custom firmware) to the Quest 3 over WebSockets in the Oculus Browser

Brilliant Wear

18,643 次观看 • 9 个月前

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Ported our firmware to the Seeed Studio XIAO ESP32-S3 Sense, allowing us to use our Wearables SDK with devices like the Omi Glass from Omi AI Stream camera and microphone data via Bluetooth or WiFi (WebSockets), and even motion data if you attach a compatible imu

Brilliant Wear

65,083 次观看 • 10 个月前

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Experimenting with wrist controls on smart glasses Using our Wearables SDK, we can display a 3D wireframe A-Frame scene on compatible smartglasses (in this case the Brilliant Labs Frame running our custom firmware) We’re also using our SDK to control a virtual cursor with our Ukaton motion module strapped to our wrist, running an Edge Impulse model to detect pinches There’s a lot of third party hand control accessories we could use (TapWithUs, Doublepoint, and Mudra Band), but using our own hardware/software is great for creating custom gestures

Brilliant Wear

29,397 次观看 • 1 年前

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Realtime Maps on Smart Glasses Using our Wearables SDK and OpenStreetMap to display a simple map overlay, allowing us to see what places are around us (and if they’re open or not) Works with compatible smart glasses (in this case the Brilliant Labs Frame running custom firmware)

Brilliant Wear

53,763 次观看 • 1 年前

You've probably heard about GPS. But have you heard about VPS? It's the visual positioning tech that gives robots and AR glasses centimeter-level accuracy where GPS fails. Here's how it works: 0:00 - Intro 0:19 - How GPS Actually Works 1:28 - The Problem with GPS for AR & Robotics 2:06 - What is VPS? (Visual Positioning System) 2:38 - Use Cases: Delivery Robots & Drones 3:17 - VPS in Action: Apple Vision Pro & Meta Quest 3:53 - Scanning Your World with an iPhone (Multiset AI) 4:31 - Key Takeaways 4:48 - The Future: Spatial Intelligence

You've probably heard about GPS. But have you heard about VPS? It's the visual positioning tech that gives robots and AR glasses centimeter-level accuracy where GPS fails. Here's how it works: 0:00 - Intro 0:19 - How GPS Actually Works 1:28 - The Problem with GPS for AR & Robotics 2:06 - What is VPS? (Visual Positioning System) 2:38 - Use Cases: Delivery Robots & Drones 3:17 - VPS in Action: Apple Vision Pro & Meta Quest 3:53 - Scanning Your World with an iPhone (Multiset AI) 4:31 - Key Takeaways 4:48 - The Future: Spatial Intelligence

Bilawal Sidhu

14,757 次观看 • 9 个月前

VPS 2.0 Outperforms GPS Alone. Niantic Spatial’s Visual Positioning System (VPS) matches live camera data to a spatial model for precise 6DoF localization—indoors, outdoors, and in complex environments where GPS fails. 🔹 ~10-15cm accuracy in mapped areas 🔹 Works in GPS-denied environments 🔹 Persistent spatial anchors Explore this deep dive to learn how VPS works: #NianticSpatial #Scaniverse #VPS #GIS #GeospatialAI #GEOINT #PhysicalAI #AI #Robotics

VPS 2.0 Outperforms GPS Alone. Niantic Spatial’s Visual Positioning System (VPS) matches live camera data to a spatial model for precise 6DoF localization—indoors, outdoors, and in complex environments where GPS fails. 🔹 ~10-15cm accuracy in mapped areas 🔹 Works in GPS-denied environments 🔹 Persistent spatial anchors Explore this deep dive to learn how VPS works: #NianticSpatial #Scaniverse #VPS #GIS #GeospatialAI #GEOINT #PhysicalAI #AI #Robotics

Niantic Spatial 🌎

19,782 次观看 • 6 个月前

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

VPS or visual positioning system... this is how AR glasses and robots will understand where they are in the real world and know where to go. It’s also how you can spatially annotate reality with cm level accuracy - all using a machine readable model of the world.

Bilawal Sidhu

28,085 次观看 • 11 个月前

Another Apple Vision Pro VPS hack. This time using Immersal 🤓 The phone position is tracked by the AVP's image tracking, the phone sends Immersal localisation information to the AVP, and the relative position of the virtual objects are calculated on the AVP. #designium #AppleVisionPro #AugmentedReality #AR #Immersal

Another Apple Vision Pro VPS hack. This time using Immersal 🤓 The phone position is tracked by the AVP's image tracking, the phone sends Immersal localisation information to the AVP, and the relative position of the virtual objects are calculated on the AVP. #designium #AppleVisionPro #AugmentedReality #AR #Immersal

mechpil0t

25,376 次观看 • 2 年前

GPS will be history soon. VPS is coming soon.....Visual Positioning System...🤩 Don’t miss this video👌

GPS will be history soon. VPS is coming soon.....Visual Positioning System...🤩 Don’t miss this video👌

Aadhavan®

305,552 次观看 • 3 年前

🏆 1st place, Open Source Lenslist AR as an interface for robot navigation. Give move-to commands using hands or voice and the robot moves there autonomously. Works in a variety of environments and conditions. Stock firmware on the Unitree dog. Dimensional powers the entire navigation stack with dynamic pathing and LiDAR streaming. UI and interactions on SPECS AR Glasses. I’m already working on v2.0 with VPS support (MultiSet AI) to reduce drift on longer distances (>5m) and cleaner DimOS integration. Gotta say, making this is a bit of a rollercoaster as it’s genuinely hard but also I just want it to exist and seeing it work is the most cool and rewarding thing ever. Repo:

🏆 1st place, Open Source Lenslist AR as an interface for robot navigation. Give move-to commands using hands or voice and the robot moves there autonomously. Works in a variety of environments and conditions. Stock firmware on the Unitree dog. Dimensional powers the entire navigation stack with dynamic pathing and LiDAR streaming. UI and interactions on SPECS AR Glasses. I’m already working on v2.0 with VPS support (MultiSet AI) to reduce drift on longer distances (>5m) and cleaner DimOS integration. Gotta say, making this is a bit of a rollercoaster as it’s genuinely hard but also I just want it to exist and seeing it work is the most cool and rewarding thing ever. Repo:

Johannes Tscharn

73,765 次观看 • 1 个月前

I bought a VeVe | Digital Collectibles collectible using $OMI 0:11 Why this video matters 0:51 Bridging $OMI with StackR 1:26 Omillionaire 2:00 My 1st ever OMI to NFT 2:45 Final thoughts on ECOMI | $OMI ⭕️ 3:13 Would love to hear your take Full video here if you want to see the process

I bought a VeVe | Digital Collectibles collectible using $OMI 0:11 Why this video matters 0:51 Bridging $OMI with StackR 1:26 Omillionaire 2:00 My 1st ever OMI to NFT 2:45 Final thoughts on ECOMI | $OMI ⭕️ 3:13 Would love to hear your take Full video here if you want to see the process

Chris ☕️

24,176 次观看 • 1 年前

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

GPT-4o Image Generation to Part-based 3D Characters with PBR, in under 10 minutes ⚡️ Workflow: 🎨 Prompt GPT-4o to get an image (e.g., "3D asset of a styled character with all parts laid on a sheet for image to 3D") 🧩 Use CSM AI's Part-based tool to generate parts and assemble in Blender.

Common Sense Machines

442,303 次观看 • 1 年前

This tool can learn any 3d spaces with just an image. It’s called OneCanvas, a NeurIPS 2026 Spotlight paper with public code and model. It merges video frames of a room into one panorama, so an ordinary image AI can answer questions about 3D space. → New state of the art on spatial reasoning benchmarks → Answers from any viewpoint, including the AI’s own position in the room → Needs depth data and camera positions, not just plain video 100% free & open-source.

This tool can learn any 3d spaces with just an image. It’s called OneCanvas, a NeurIPS 2026 Spotlight paper with public code and model. It merges video frames of a room into one panorama, so an ordinary image AI can answer questions about 3D space. → New state of the art on spatial reasoning benchmarks → Answers from any viewpoint, including the AI’s own position in the room → Needs depth data and camera positions, not just plain video 100% free & open-source.

Simplifying AI

19,455 次观看 • 26 天前

Your definitive source for everything OMI just got an upgrade⭕️ Meet the new How staking works, how to get your OMI onto Base, official contract addresses, and answers to the questions we're hearing most. Your journey starts here. $OMI

Your definitive source for everything OMI just got an upgrade⭕️ Meet the new How staking works, how to get your OMI onto Base, official contract addresses, and answers to the questions we're hearing most. Your journey starts here. $OMI

ECOMI | $OMI ⭕️

16,245 次观看 • 1 个月前

Every time I think the ESP32-S3 has hit its limit, someone finds another gear. This open-source Jet renderer is now pushing the S3 even harder. Real-time screen-space reflections, water ripple distortion, lens flare and 8 ships on screen, all running on a tiny MCU. Performance dropped from around 60 FPS to 45–50 FPS, but that's still wild for an ESP32-S3. And the developer thinks there is more performance left to squeeze out. No GPU. No desktop CPU. Just an ESP32-S3 doing real-time 3D graphics.

Every time I think the ESP32-S3 has hit its limit, someone finds another gear. This open-source Jet renderer is now pushing the S3 even harder. Real-time screen-space reflections, water ripple distortion, lens flare and 8 ships on screen, all running on a tiny MCU. Performance dropped from around 60 FPS to 45–50 FPS, but that's still wild for an ESP32-S3. And the developer thinks there is more performance left to squeeze out. No GPU. No desktop CPU. Just an ESP32-S3 doing real-time 3D graphics.

Praveen Kumar Verma

15,924 次观看 • 2 个月前

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..

Experimenting with Gaussian splatting as a scene representation for monocular autonomous driving. visualization using Rerun running through a custom Apple ML-Sharp based pipeline..

Jaskirat Singh

18,719 次观看 • 9 个月前

Live monocular 3D reconstruction from camera feed, with multi-frame stitching and relative positioning (frame buffer of 4)... running on M3 mac cpu at 24fps... visualised using Rerun next up... realtime semantic navigation in 3d space...

Live monocular 3D reconstruction from camera feed, with multi-frame stitching and relative positioning (frame buffer of 4)... running on M3 mac cpu at 24fps... visualised using Rerun next up... realtime semantic navigation in 3d space...

ud

22,080 次观看 • 9 个月前