Loading video...

Video Failed to Load

Go Home

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

21,819 views • 2 years ago •via X (Twitter)

7 Comments

Stijn Spanhove's profile picture
Stijn Spanhove2 years ago

We introduced two solutions: - Protective Cubes: you are surrounded by cubes that serve as a protective barrier and make noise when they collide with real-life obstacles. Via hand tracking, you have a virtual blind stick that makes noise when it hits a target.

Stijn Spanhove's profile picture
Stijn Spanhove2 years ago

- Obstacle Detection with Audio Cues: via horizontal and vertical plane detection, obstacles make sounds to warn you if you're close. The sound increases rapidly, just like a car’s proximity sensors.

Stijn Spanhove's profile picture
Stijn Spanhove2 years ago

Great teamwork @itpocket 🙌

Mikameel ᯅ's profile picture
Mikameel ᯅ2 years ago

@Apple wow amazing have you thought of haptics additional to sound feedback, to replace the stick?

Stijn Spanhove's profile picture
Stijn Spanhove2 years ago

@Apple Thank you, we haven't thought about haptics, focused on sound. That would be interesting!

realdawei ᯅ's profile picture
realdawei ᯅ2 years ago

@Apple Yo! This is brilliant

Sheikh Shafayat's profile picture
Sheikh Shafayat2 years ago

@Apple this is really cool

Related Videos