Video wird geladen...
Video konnte nicht geladen werden
🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.
21,808 Aufrufe • vor 2 Jahren •via X (Twitter)
7 Kommentare

We introduced two solutions: - Protective Cubes: you are surrounded by cubes that serve as a protective barrier and make noise when they collide with real-life obstacles. Via hand tracking, you have a virtual blind stick that makes noise when it hits a target.

- Obstacle Detection with Audio Cues: via horizontal and vertical plane detection, obstacles make sounds to warn you if you're close. The sound increases rapidly, just like a car’s proximity sensors.

Great teamwork @itpocket 🙌

@Apple wow amazing have you thought of haptics additional to sound feedback, to replace the stick?

@Apple Thank you, we haven't thought about haptics, focused on sound. That would be interesting!

@Apple Yo! This is brilliant

@Apple this is really cool

