Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

With camera access on Apple Vision Pro, the possibilities are endless! In this POC, I combined Gemini 2.0 Flash with XR to create a realtime hands-free experience. 💡 It sees what you see, responds to your voice, and delivers extra info in XR. Below are some simple examples.

stspanho's profile picture

Stijn Spanhove

2,880 subscribers

13,858 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Imagine fine-tuning it for your workflows to show manuals, business insights, or process guides. All hands-free with Gemini 2.0 realtime @GoogleARVR

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Solving math problems

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Translations

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Playing games

Profilbild von WillScuderi
WillScuderivor 1 Jahr

Great rundown of our new product using it on the road 🏎️ with your Mac and PC and then on planes ✈️ with your iPhone for watching movies is a game changer ✅ Aluminium Build ✅ Works with one cable for Mac, PC, iPhone (15 and later) ✅ 1080p/16m colours/300nits ✅ 0.2"/5mm thin

Profilbild von Bryan Keller
Bryan Kellervor 1 Jahr

Is this using an enterprise dev entitlement?

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Yes I'm using an enterprise API for camera access

Profilbild von Carlos Aguilar
Carlos Aguilarvor 1 Jahr

Is this using enterprise APIs?

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

Yes with the enterprise API you can have camera access.

Profilbild von Dre Smith
Dre Smithvor 1 Jahr

This is cool… I need to check out Gemini 2.0

Profilbild von Stijn Spanhove
Stijn Spanhovevor 1 Jahr

You should! 😉

Ähnliche Videos

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.
1:00

I loved being one of the first directors to use Apple Vision Pro! I was completely blown away with how it helps you play, create, and explore new worlds. Watch Wicked now on the Apple TV app, and experience it in 3D on Apple Vision Pro.

Jon M. Chu

378,694 Aufrufe • vor 1 Jahr

Disney Imagineers cooked up a HoloTile floor, so you can walk around in virtual spaces and it adapts to your movements. In 5 years, this floor combined with Apple Vision Pro combined with GTA VII will be the most insane gaming experience ever.
1:14

Disney Imagineers cooked up a HoloTile floor, so you can walk around in virtual spaces and it adapts to your movements. In 5 years, this floor combined with Apple Vision Pro combined with GTA VII will be the most insane gaming experience ever.

Trung Phan

1,395,846 Aufrufe • vor 2 Jahren

Introducing Gemini 2.0 Flash with Google AI Studio in PyCharm... Totally Free! 🤩 In just one minute, I'll show you how to connect your Google AI Studio account and start using the Gemini 2.0 Flash and Gemini 2.0 Flash Thinking models for free. Save this video to stay updated on all the latest Google DeepMind models available in JetBrains editors! PyCharm, a JetBrains IDE CodeGPT Google for Developers
1:17

Introducing Gemini 2.0 Flash with Google AI Studio in PyCharm... Totally Free! 🤩 In just one minute, I'll show you how to connect your Google AI Studio account and start using the Gemini 2.0 Flash and Gemini 2.0 Flash Thinking models for free. Save this video to stay updated on all the latest Google DeepMind models available in JetBrains editors! PyCharm, a JetBrains IDE CodeGPT Google for Developers

Daniel San

65,294 Aufrufe • vor 1 Jahr

XREAL and Google are extending our strategic partnership in a new multi‑year agreement, with XREAL named a lead hardware partner for the Android XR ecosystem. Building on Project Aura (coming in 2026), we’re aligning our long‑term hardware roadmap with Android XR—bringing it to optical see‑through devices, including wired XR glasses, and expanding support for Android XR development. Read more: Also—peep the Android XR alien lighting up the Vegas Sphere at CES 2026 😎 #AndroidXR #XR #AR #XREAL #Google
1:00

XREAL and Google are extending our strategic partnership in a new multi‑year agreement, with XREAL named a lead hardware partner for the Android XR ecosystem. Building on Project Aura (coming in 2026), we’re aligning our long‑term hardware roadmap with Android XR—bringing it to optical see‑through devices, including wired XR glasses, and expanding support for Android XR development. Read more: Also—peep the Android XR alien lighting up the Vegas Sphere at CES 2026 😎 #AndroidXR #XR #AR #XREAL #Google

XREAL 👓

22,199 Aufrufe • vor 7 Monaten

introducing realtime video model from rumik after Google and OpenAI we are the 3rd lab in the world to make this generally available very excited to put this in your hands and see what you build with this
2:28

introducing realtime video model from rumik after Google and OpenAI we are the 3rd lab in the world to make this generally available very excited to put this in your hands and see what you build with this

rohan

11,735 Aufrufe • vor 17 Tagen

I think people are still sleeping on realtime voice driven consumer experiences.. Releasing my latest side project geared towards kids: Upon A Voice ✨ You can watch my daughter interact with it in the video below but the highlights are as follows: - generates a "live" storybook based on who your child is and how they look. - the story is completely driven by voice and what the kid wants to see in the book. - images are generated in real time keeping the character consistent. - at the end, you get a full PDF that you can print and hand to your child to read as a bedtime story Live now at uponavoice dot com with a BYO Gemini key!
2:00

I think people are still sleeping on realtime voice driven consumer experiences.. Releasing my latest side project geared towards kids: Upon A Voice ✨ You can watch my daughter interact with it in the video below but the highlights are as follows: - generates a "live" storybook based on who your child is and how they look. - the story is completely driven by voice and what the kid wants to see in the book. - images are generated in real time keeping the character consistent. - at the end, you get a full PDF that you can print and hand to your child to read as a bedtime story Live now at uponavoice dot com with a BYO Gemini key!

Nikunj Kothari

27,953 Aufrufe • vor 1 Monat

Imagine stepping into your embeddings that power RAG. 📚 In this proof of concept, you’re surrounded by courses. Semantically similar ones float right next to each other. I've built an XR prototype with Rémi at In The Pocket where you can stand inside your knowledge base on Apple Vision Pro. Ask a question and the AI lights up the relevant documents in space, so you literally see where your answer comes from. When you ask something specific like "I want to be an astronaut, what can I learn", only a few tight clusters glow. But ask "I'm bored, what could be something fun to study" and clusters across the space light up. #applevisionpro #artificialintelligence #xr #rag
1:57

Imagine stepping into your embeddings that power RAG. 📚 In this proof of concept, you’re surrounded by courses. Semantically similar ones float right next to each other. I've built an XR prototype with Rémi at In The Pocket where you can stand inside your knowledge base on Apple Vision Pro. Ask a question and the AI lights up the relevant documents in space, so you literally see where your answer comes from. When you ask something specific like "I want to be an astronaut, what can I learn", only a few tight clusters glow. But ask "I'm bored, what could be something fun to study" and clusters across the space light up. #applevisionpro #artificialintelligence #xr #rag

Stijn Spanhove

24,747 Aufrufe • vor 6 Monaten

We asked Gemini 3.5 Flash to bring back the classic early-2000s PC drawing experience, and it delivered in one shot. What are you building first with Canvas?
0:28

We asked Gemini 3.5 Flash to bring back the classic early-2000s PC drawing experience, and it delivered in one shot. What are you building first with Canvas?

Google Gemini

22,294,081 Aufrufe • vor 2 Monaten

FreeTimeGS – Free Gaussian Primitives Anywhere, Anytime – has been making waves online over the past two days. You may have already seen it. If not, here’s a great example: a live demo with minimal cleanup and no heavy post-production. What’s remarkable is the simplicity of their setup. This example shows a basic semicircle rig made from smartphones and budget light stands. No complex volumetric or photogrammetry system required—and yet, the result plays smoothly right in a mobile browser. Yes, even on my iPhone. You can also view this on Vision Pro! The next logical step? Let’s bring this into the new Spatial Web standard IEEE IEEE 2874 and make it viewable in Apple Vision Pro, Android XR, and other upcoming headsets via open source XR web browser. Imagine freely flying through AI-powered Gaussian reconstructions directly in spatial environments cross platforms. We’re witnessing a major leap in spatial computing. AI-powered tools like this are reshaping every part of the creative pipeline. Can't wait to see what Apple has to say tomorrow at WWDC 25! Are you ready for it? What use cases excite you most? Drop your thoughts below—let’s discuss.
0:44

FreeTimeGS – Free Gaussian Primitives Anywhere, Anytime – has been making waves online over the past two days. You may have already seen it. If not, here’s a great example: a live demo with minimal cleanup and no heavy post-production. What’s remarkable is the simplicity of their setup. This example shows a basic semicircle rig made from smartphones and budget light stands. No complex volumetric or photogrammetry system required—and yet, the result plays smoothly right in a mobile browser. Yes, even on my iPhone. You can also view this on Vision Pro! The next logical step? Let’s bring this into the new Spatial Web standard IEEE IEEE 2874 and make it viewable in Apple Vision Pro, Android XR, and other upcoming headsets via open source XR web browser. Imagine freely flying through AI-powered Gaussian reconstructions directly in spatial environments cross platforms. We’re witnessing a major leap in spatial computing. AI-powered tools like this are reshaping every part of the creative pipeline. Can't wait to see what Apple has to say tomorrow at WWDC 25! Are you ready for it? What use cases excite you most? Drop your thoughts below—let’s discuss.

Hugh Hou

12,665 Aufrufe • vor 1 Jahr

Go to NASA's YouTube channel right now on your Apple Vision Pro or Samsung Galaxy XR. You can watch the Artemis II launch in 8K 360. It feels like you're standing at Kennedy Space Center as the rocket takes off.
0:22

Go to NASA's YouTube channel right now on your Apple Vision Pro or Samsung Galaxy XR. You can watch the Artemis II launch in 8K 360. It feels like you're standing at Kennedy Space Center as the rocket takes off.

Spatial Insider

233,752 Aufrufe • vor 4 Monaten

Really happy to see the interest around our “Hands-on with Gemini” video. In our developer blog yesterday, we broke down how Gemini was used to create it. We gave Gemini sequences of different modalities — image and text in this case — and had it respond by predicting what might come next. Devs can try similar things when access to Pro opens on 12/13 🚀. The knitting demo used Ultra⚡ All the user prompts and outputs in the video are real, shortened for brevity. The video illustrates what the multimodal user experiences built with Gemini could look like. We made it to inspire developers. When you’re building an app, you can get similar results (there’s always some variability with LLMs) by prompting Gemini with an instruction that allows the user to "configure" the behavior of the model, like inputting “you are an expert in science …” before a user can engage in the same kind of back and forth dialogue. Here’s a clip of what this looks like in AI Studio with Gemini Pro. We’ve come a long way since Flamingo 🦩 & PALI, looking forward to seeing what people build with it!
2:24

Really happy to see the interest around our “Hands-on with Gemini” video. In our developer blog yesterday, we broke down how Gemini was used to create it. We gave Gemini sequences of different modalities — image and text in this case — and had it respond by predicting what might come next. Devs can try similar things when access to Pro opens on 12/13 🚀. The knitting demo used Ultra⚡ All the user prompts and outputs in the video are real, shortened for brevity. The video illustrates what the multimodal user experiences built with Gemini could look like. We made it to inspire developers. When you’re building an app, you can get similar results (there’s always some variability with LLMs) by prompting Gemini with an instruction that allows the user to "configure" the behavior of the model, like inputting “you are an expert in science …” before a user can engage in the same kind of back and forth dialogue. Here’s a clip of what this looks like in AI Studio with Gemini Pro. We’ve come a long way since Flamingo 🦩 & PALI, looking forward to seeing what people build with it!

Oriol Vinyals

180,991 Aufrufe • vor 2 Jahren

With Gemini 3 in Search, you can now create interactive tools and simulations to visualize complex topics. It’s been really great to see the creative ways people are using it for things like seeing how photosynthesis works or how a vinyl record produces sound. Here are some of my favorite examples of what Gemini 3 in AI Mode can do:
0:37

With Gemini 3 in Search, you can now create interactive tools and simulations to visualize complex topics. It’s been really great to see the creative ways people are using it for things like seeing how photosynthesis works or how a vinyl record produces sound. Here are some of my favorite examples of what Gemini 3 in AI Mode can do:

Rajan Patel

26,324 Aufrufe • vor 9 Monaten

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.
1:09

🦯 How to help visually impaired people easily navigate through everyday life with the Apple Vision Pro? I know it's not the expected use case of an XR headset, but you can do it with real-time meshing, hand tracking, and spatial audio.

Stijn Spanhove

21,819 Aufrufe • vor 2 Jahren

I made a sprite animator using Google's Gemini 2.0 flash experimental. Here's how it works: 1. Gemini 2.0 exp generates the images 2. They are uploaded each in an S3 bucket/folder 3. Then you can use WebGPU /w canvas or just img Let's watch some examples and generate some:
2:32

I made a sprite animator using Google's Gemini 2.0 flash experimental. Here's how it works: 1. Gemini 2.0 exp generates the images 2. They are uploaded each in an S3 bucket/folder 3. Then you can use WebGPU /w canvas or just img Let's watch some examples and generate some:

wavefnx

353,002 Aufrufe • vor 1 Jahr