
Robi ᯅ
@xrdevrob • 1,741 subscribers
Building cool XR & AI apps, prev. Meta RL 🇨🇭
Shorts
Videos

Hi XR devs! Big day today. v83 of the Meta XR SDK is officially out and it includes something very special to me 🦙. For the past 6 months we’ve been building AI Inference Building Blocks, which you may have seen teased at Meta Connect 2025. Our goal: keep the simplicity of Building Blocks while giving you the freedom to plug in any AI provider or model you want to power you apps with AI. More details and a full step-by-step guide are coming soon. And stay tuned as two more iterations are already locked in for early next year with new capabilities and major performance and inference improvements like you've never seen on Meta Quest. 🚀 For now, learn more on the Meta Horizon OS Developer Center:
Robi ᯅ12,235 Aufrufe • vor 5 Monaten

Passthrough Camera access (PCA) on Quest may have taken a while and I already see some devs doubting the impact this will have for XR. I think the most fun thing about PCA is, that there are such smart devs out there, that we cannot even begin to imagine what some people will come up with, and I am very much looking forward to that. Below is another sample I made and included in my QuestCameraKit GitHub repo. It is using API calls to OpenAI vision and whisper and is capable of understanding and responding in virtually any language (English and German below):
Robi 🔜 Meta Connect ᯅ11,831 Aufrufe • vor 1 Jahr
Keine weiteren Inhalte verfügbar