Stijn Spanhove's banner

Stijn Spanhove

@stspanho • 4,156 subscribers

Software engineer @itpocket | Sharing my experiments with AI and XR https://t.co/A2bBDqRBEb

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

🏃‍♂️ I've gamified my own run so I can race my own ghost with the Meta Ray-Ban Display. I built a web app for the glasses, loaded a previous GPX from Strava, and dropped game mechanics on top. Pick up coins when you keep pace, sprint zones reward extra points if you push, and a mini leaderboard on the lens shows how you're tracking against your past self in real time. Best part: it actually works. Seeing your ghost 20 m ahead is a way stronger nudge than any number on a watch. 😅

🏃‍♂️ I've gamified my own run so I can race my own ghost with the Meta Ray-Ban Display. I built a web app for the glasses, loaded a previous GPX from Strava, and dropped game mechanics on top. Pick up coins when you keep pace, sprint zones reward extra points if you push, and a mini leaderboard on the lens shows how you're tracking against your past self in real time. Best part: it actually works. Seeing your ghost 20 m ahead is a way stronger nudge than any number on a watch. 😅

1,432,288 Aufrufe • vor 9 Tagen

🚫🕶️ I've been building an XR app for a real-world ad blocker using Snap Spectacles. It uses Gemini to detect and block ads in the environment. It’s still early and experimental, but it’s exciting to imagine a future where you control the physical content you see.

Sensitive content

This media may contain sensitive content.

🚫🕶️ I've been building an XR app for a real-world ad blocker using Snap Spectacles. It uses Gemini to detect and block ads in the environment. It’s still early and experimental, but it’s exciting to imagine a future where you control the physical content you see.

307,547 Aufrufe • vor 11 Monaten

Imagine stepping into your embeddings that power RAG. 📚 In this proof of concept, you’re surrounded by courses. Semantically similar ones float right next to each other. I've built an XR prototype with Rémi at In The Pocket where you can stand inside your knowledge base on Apple Vision Pro. Ask a question and the AI lights up the relevant documents in space, so you literally see where your answer comes from. When you ask something specific like "I want to be an astronaut, what can I learn", only a few tight clusters glow. But ask "I'm bored, what could be something fun to study" and clusters across the space light up. #applevisionpro #artificialintelligence #xr #rag

Imagine stepping into your embeddings that power RAG. 📚 In this proof of concept, you’re surrounded by courses. Semantically similar ones float right next to each other. I've built an XR prototype with Rémi at In The Pocket where you can stand inside your knowledge base on Apple Vision Pro. Ask a question and the AI lights up the relevant documents in space, so you literally see where your answer comes from. When you ask something specific like "I want to be an astronaut, what can I learn", only a few tight clusters glow. But ask "I'm bored, what could be something fun to study" and clusters across the space light up. #applevisionpro #artificialintelligence #xr #rag

24,315 Aufrufe • vor 3 Monaten

🏀 I built this PoC using a single 2D broadcast video: applied pitch detection, player positioning, and movement tracking to reconstruct the play in 3D and map it onto a real basketball court in XR.

🏀 I built this PoC using a single 2D broadcast video: applied pitch detection, player positioning, and movement tracking to reconstruct the play in 3D and map it onto a real basketball court in XR.

36,870 Aufrufe • vor 6 Monaten

Generative AI and WebAR are so powerful 🤩 In this experiment I used Stable Diffusion Depth2img, Three.js and 8thwall Visual Positioning System. #8thwall #niantic #stablediffusion #threejs

Generative AI and WebAR are so powerful 🤩 In this experiment I used Stable Diffusion Depth2img, Three.js and 8thwall Visual Positioning System. #8thwall #niantic #stablediffusion #threejs

113,895 Aufrufe • vor 3 Jahren

🕹️ Turning drawings into XR worlds you can play in. I built a POC for Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

🕹️ Turning drawings into XR worlds you can play in. I built a POC for Spectacles that turns imagination into reality. My niece drew a picture and with the help of Mirage 2, I brought it to life in an interactive environment.

36,913 Aufrufe • vor 9 Monaten

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

From 2D video to a very rough 4D Gaussian Splatting POC on the Apple Vision Pro 👀 Took Big Buck Bunny frames, turned them into Gaussian splats with Sharp (Apple), compressed them with PlayCanvas splat transform to SOG, and played all frames via WebXR + spark Still rough and not fully optimized, but wow, dynamic GS in AVP feels wild 🤯 Second part of the video is on my laptop #threejs

20,127 Aufrufe • vor 5 Monaten

🧑‍🍳 Experiment with a multimodal LLM in WebAR. The AI identifies ingredients, sets up bounding boxes, and prepares them for AR. I'm also using open-source models to generate recipes and corresponding images. #threejs #8thwall #generativeai

🧑‍🍳 Experiment with a multimodal LLM in WebAR. The AI identifies ingredients, sets up bounding boxes, and prepares them for AR. I'm also using open-source models to generate recipes and corresponding images. #threejs #8thwall #generativeai

61,019 Aufrufe • vor 2 Jahren

An experiment with 𝘃𝗶𝗿𝘁𝘂𝗮𝗹 𝘁𝗿𝘆-𝗼𝗻 in WebAR 👇 👕 The GenAI-model seamlessly maps pictures onto my 3D-body in AR, all running smoothly on the web. Cool to see the results 👀 #generativeai #threejs #8thwall

An experiment with 𝘃𝗶𝗿𝘁𝘂𝗮𝗹 𝘁𝗿𝘆-𝗼𝗻 in WebAR 👇 👕 The GenAI-model seamlessly maps pictures onto my 3D-body in AR, all running smoothly on the web. Cool to see the results 👀 #generativeai #threejs #8thwall

41,804 Aufrufe • vor 2 Jahren

My first AR Lens for Spectacles! 📸 Frame a scene with your fingers, and it’ll generate spatial pixel art that blends into your surroundings.

My first AR Lens for Spectacles! 📸 Frame a scene with your fingers, and it’ll generate spatial pixel art that blends into your surroundings.

26,681 Aufrufe • vor 1 Jahr

🚵 I've been working on this for quite some time. Wanted to explore if it's possible to watch cycling in AR (Quest 3 and AVP). Tried it with the Ronde Van Vlaanderen but was not able to gather enough data. With the Tour De France I was able to create this POC #webxr #TourdeFrance

🚵 I've been working on this for quite some time. Wanted to explore if it's possible to watch cycling in AR (Quest 3 and AVP). Tried it with the Ronde Van Vlaanderen but was not able to gather enough data. With the Tour De France I was able to create this POC #webxr #TourdeFrance

34,324 Aufrufe • vor 1 Jahr

In this experiment you can bring your scribbles to life with just a prompt! 🎨 I've used Stable Diffusion, ControlNet, a 360° Lora and 8th Wall's Sky segmentation. #stablediffusion #controlnet #threejs #8thwall

In this experiment you can bring your scribbles to life with just a prompt! 🎨 I've used Stable Diffusion, ControlNet, a 360° Lora and 8th Wall's Sky segmentation. #stablediffusion #controlnet #threejs #8thwall

39,212 Aufrufe • vor 3 Jahren

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

21,804 Aufrufe • vor 2 Jahren

With camera access on Apple Vision Pro, the possibilities are endless! In this POC, I combined Gemini 2.0 Flash with XR to create a realtime hands-free experience. 💡 It sees what you see, responds to your voice, and delivers extra info in XR. Below are some simple examples.

With camera access on Apple Vision Pro, the possibilities are endless! In this POC, I combined Gemini 2.0 Flash with XR to create a realtime hands-free experience. 💡 It sees what you see, responds to your voice, and delivers extra info in XR. Below are some simple examples.

13,858 Aufrufe • vor 1 Jahr

🚀 Just launched… a Starship! (Well, in AR 😉) Built an AR experience for Snapchat Spectacles where you launch a SpaceX Starship, and guide the booster back to a 3D-printed launch tower using a pinch gesture. Super interesting to blend physical objects with spatial interaction!

🚀 Just launched… a Starship! (Well, in AR 😉) Built an AR experience for Snapchat Spectacles where you launch a SpaceX Starship, and guide the booster back to a 3D-printed launch tower using a pinch gesture. Super interesting to blend physical objects with spatial interaction!

10,799 Aufrufe • vor 1 Jahr

Keine weiteren Inhalte verfügbar