A developer figured out how to access Quest 3's passthrough cameras to run custom computer vision models. Details here:

Proud to work on this team. Always thinking outside the box 🎁

oh my god video encode then decode and using a compressed video stream for CV? this thing sure is horribly inefficient (Facebook's fault)

nice, i'm using the same approach and can verify it works like that! :)

@cixliv 🧐

@cixliv I mean its not meta giving access but it's something

amazing MR not only allows me to see real reality now but also tells dumbass me what I'm seeing!

I hope this becoms standard access for devs. MR "needs" camera info to be MR otherwise it's a glorified versoin of AR. (Eg, you can actually remove objetcs and modify them much better than whats now possible with AR games. rn quest apps cant access the camera.)