3D hand tracking on smart glasses Not only can we stream camera data with our Wearables SDK, but we can run MediaPipe for hand tracking, applying it in WebXR environments like Three.js and A-Frame Works with compatible smart glasses, in this case the Omi AI Omi Glass, based on... the Seeed Studio XIAO ESP32-S3 Sense (running our custom Firmware)show more

i just made a small project to stream the video from the rayban metas to mac, it needs some more work but it would be fun to bring it together with this if yours is an open source repo and you can link it to me that would be cool :) mine is here: i need to improve it still but i only started yesterday

@threejs @aframevr @omidotme 沉浸感直接拉满

@threejs @aframevr @omidotme feels like we’re inching closer to real AR-native interfaces here

@threejs @aframevr @omidotme Once gesture recognition is this fluid, you’re basically deleting every UI layer we know. Interfaces just… vanish.

@threejs @aframevr @omidotme wild to think this could replace touchscreens

@threejs @aframevr @omidotme @BrianRoemmele

@threejs @aframevr @omidotme Next level stuff

@threejs @aframevr @omidotme Now, recording this all waking hours across all users to train a robotic AI control system ?

@threejs @aframevr @omidotme Good stuff, I like that chipset

@threejs @aframevr @omidotme Cool tech! Hand tracking on smart glasses is the future.

@threejs @aframevr @omidotme So you basically have a Xiao sense driving this with *media pipe* ? Love it

@threejs @aframevr @omidotme wild potential

@threejs @aframevr @omidotme Are there any othr usecases of this rather than this?

@threejs @aframevr @omidotme This is how interfaces quietly disappear. When interaction becomes physical, software stops feeling like software and starts feeling like an extension of the body.

@threejs @aframevr @omidotme Wild.

@threejs @aframevr @omidotme cool

@threejs @aframevr @omidotme Excellent

@threejs @aframevr @omidotme 这才是真·沉浸