正在加载视频...

视频加载失败

返回首页

Build AR applications that recognize physical objects and provide real-time spatial guidance. Stijn Spanhove and Pavlo Tkachenko used Gemini 2.5 Pro’s multimodal vision and sound effect prompting capabilities to create an immersive experience with LEGO Smart Bricks and Snap Spectacles.

googleaidevs's profile picture

Google AI Developers

115,006 subscribers

48,170 次观看 • 4 个月前 •via X (Twitter)

科学技术
LIVE

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾
0:20

Gemini 2.5 is driving new advancements in robotics with its strong coding, spatial reasoning, and multimodal capabilities. 🦾

Google AI Developers

36,119 次观看 • 1 年前

Future of immersive games is bright. I played the tower defense but it’s an apple game, you can control the drone by moving the Banana 🍌 Great work Pavlo Tkachenko Stijn Spanhove
0:51

Future of immersive games is bright. I played the tower defense but it’s an apple game, you can control the drone by moving the Banana 🍌 Great work Pavlo Tkachenko Stijn Spanhove

Mikameel ᯅ

14,415 次观看 • 3 个月前

Imagine you're building something with Lego and the bricks automatically recognize what structure is being build! Introducing Smart Cellular Bricks: Project page: PDF:
0:20

Imagine you're building something with Lego and the bricks automatically recognize what structure is being build! Introducing Smart Cellular Bricks: Project page: PDF:

Sebastian Risi

11,637 次观看 • 8 个月前

🚀 Just launched… a Starship! (Well, in AR 😉) Built an AR experience for Snapchat Spectacles where you launch a SpaceX Starship, and guide the booster back to a 3D-printed launch tower using a pinch gesture. Super interesting to blend physical objects with spatial interaction!
0:46

🚀 Just launched… a Starship! (Well, in AR 😉) Built an AR experience for Snapchat Spectacles where you launch a SpaceX Starship, and guide the booster back to a 3D-printed launch tower using a pinch gesture. Super interesting to blend physical objects with spatial interaction!

Stijn Spanhove

10,799 次观看 • 1 年前

This developer made an AR glasses demo that blocks ads in real life. Source: Stijn Spanhove
0:25

This developer made an AR glasses demo that blocks ads in real life. Source: Stijn Spanhove

Nathie 🔜 AWE

15,490 次观看 • 11 个月前

Lego announced its Lego Smart Play platform on Monday, which introduces new smart bricks, tags and special minifigs for your collection. The new bricks contain sensors that enable them to sense light and distance, and to provide an array of responses.
1:13

Lego announced its Lego Smart Play platform on Monday, which introduces new smart bricks, tags and special minifigs for your collection. The new bricks contain sensors that enable them to sense light and distance, and to provide an array of responses.

The Associated Press

109,459 次观看 • 5 个月前

Build a Vision RAG app with Gemini 2.5 Flash and Cohere Multimodal Embedding that can understand images and diagrams in PDF. 100% Opensource code with step-by-step tutorial.
0:52

Build a Vision RAG app with Gemini 2.5 Flash and Cohere Multimodal Embedding that can understand images and diagrams in PDF. 100% Opensource code with step-by-step tutorial.

Shubham Saboo

60,638 次观看 • 1 年前

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.
6:53

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.

Google AI Developers

27,676 次观看 • 1 年前

The future! Gemini Live API on Smart Glasses. Build with Brilliant Labs Frame featuring REALTIME Google DeepMind Gemini VOICE and VISION, bringing powerful multimodal AI directly to your eyes! Code is open source and available for Android and iOS.
1:47

The future! Gemini Live API on Smart Glasses. Build with Brilliant Labs Frame featuring REALTIME Google DeepMind Gemini VOICE and VISION, bringing powerful multimodal AI directly to your eyes! Code is open source and available for Android and iOS.

Philipp Schmid

16,051 次观看 • 1 年前

✨ Build real-time conversational agents with Gemini 3.1 Flash Live. Improve user interactions with technology that supports natural conversations across 90+ languages, accent changes, and multimodal inputs.
1:08

✨ Build real-time conversational agents with Gemini 3.1 Flash Live. Improve user interactions with technology that supports natural conversations across 90+ languages, accent changes, and multimodal inputs.

Google for Developers

16,987 次观看 • 2 个月前

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓
2:30

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓

Google DeepMind

117,701 次观看 • 1 年前

How does an AI model actually learn to see? 🤖 Learn about the tech behind native multimodality, how models reason over visual data like documents and video, and the future of proactive AI assistants with Logan Kilpatrick and Gemini Model Behavior Product Lead, Ani Baddepudi. ↓ Timestamps: 01:12 Why Gemini is natively multimodal 02:23 The technology behind multimodal models 05:15 Video understanding with Gemini 2.5 09:25 Deciding what to build next 13:23 Building new product experiences with multimodal AI 17:15 The vision for proactive assistants 24:13 Improving video usability with variable FPS and frame tokenization 27:35 What’s next for Gemini’s multimodal development 31:47 Deep dive on Gemini’s document understanding capabilities 37:56 The teamwork and collaboration behind Gemini 40:56 What’s next with model behavior
44:17

How does an AI model actually learn to see? 🤖 Learn about the tech behind native multimodality, how models reason over visual data like documents and video, and the future of proactive AI assistants with Logan Kilpatrick and Gemini Model Behavior Product Lead, Ani Baddepudi. ↓ Timestamps: 01:12 Why Gemini is natively multimodal 02:23 The technology behind multimodal models 05:15 Video understanding with Gemini 2.5 09:25 Deciding what to build next 13:23 Building new product experiences with multimodal AI 17:15 The vision for proactive assistants 24:13 Improving video usability with variable FPS and frame tokenization 27:35 What’s next for Gemini’s multimodal development 31:47 Deep dive on Gemini’s document understanding capabilities 37:56 The teamwork and collaboration behind Gemini 40:56 What’s next with model behavior

Google AI

58,703 次观看 • 11 个月前

Engineer builds AR ad blocker for real life using Snap Spectacles and Gemini AI | Aamir Khollam, Interesting Engineering A prototype AR app detects ads in your surroundings and blocks them live through Snap Spectacles using Google’s Gemini AI. You can pay for YouTube Premium to avoid watching ads during your sacred food-with-YouTube ritual, or pay for Spotify to not pester you with ads while you try to get a morning workout in, but what can you do about real-life advertisements? A Belgian software developer may have found a workaround. Stijn Spanhove has created an experimental augmented reality app that detects and digitally covers physical ads like billboards and soda cans in the real world. Built for Snap’s fifth-generation AR glasses (Snap Spectacles), the prototype uses Google’s Gemini AI to identify branded content and instantly mask it. Instead of the original imagery, the app places a bright red square over the detected ad. These red blocks also name the hidden brand, like “Bol. billboard,” turning ad removal into a kind of real-time brand callout. “It’s exciting to imagine a future where you control the physical content you see,” Spanhove posted on X (formerly Twitter). In follow-up replies, he hinted at additional features, including options to replace the red square with personal photos or text from a notes app. Check it out below – Combines Snap and Google tools The app relies on Snap’s Depth Cache API to register objects in 3D space and maintain spatial consistency as the user moves. Gemini, Google’s generative AI model, identifies the ads themselves, whether on large posters, newspaper pages, or food packaging. This allows the blocker to function beyond obvious signage. In demo clips shared by Spanhove, it successfully covers ads on cereal boxes, magazines, and public signage, though not without a delay of a second or two. The red overlays appear to float stably, following head movements and perspective shifts with accuracy. Still, it’s early days. Spanhove describes the software as “experimental,” and the user experience reflects that. Because Snap Spectacles use transparent displays, the overlays can’t fully block light, so the original ad sometimes faintly shows through. Also, the Spectacles’ narrow 46-degree field of view limits coverage to only what’s directly ahead. Design stirs debate The app has sparked strong reactions online. Many praised the concept of user-controlled visual space, while others criticized the bold red boxes as more jarring than the ads themselves. One suggestion, from user Hexographer ⬣Backup account⬣, proposed replacing the red blocks with more visually pleasing alternatives, such as “images of local foliage or animal life.” They also suggested that users could set a custom folder of replacement visuals, including personal or family photos. Others asked for cross-platform support, but the app currently only works with Snap Spectacles. Devices like the Apple Vision Pro or Meta Quest will need separate development efforts. Despite its limitations, the project arrives at a moment when major tech firms like Meta and Microsoft have scaled back their AR ambitions. Snap, meanwhile, continues renting its Spectacles to developers at $99 per month, making experiments like Spanhove’s possible. Read more:
0:29

Engineer builds AR ad blocker for real life using Snap Spectacles and Gemini AI | Aamir Khollam, Interesting Engineering A prototype AR app detects ads in your surroundings and blocks them live through Snap Spectacles using Google’s Gemini AI. You can pay for YouTube Premium to avoid watching ads during your sacred food-with-YouTube ritual, or pay for Spotify to not pester you with ads while you try to get a morning workout in, but what can you do about real-life advertisements? A Belgian software developer may have found a workaround. Stijn Spanhove has created an experimental augmented reality app that detects and digitally covers physical ads like billboards and soda cans in the real world. Built for Snap’s fifth-generation AR glasses (Snap Spectacles), the prototype uses Google’s Gemini AI to identify branded content and instantly mask it. Instead of the original imagery, the app places a bright red square over the detected ad. These red blocks also name the hidden brand, like “Bol. billboard,” turning ad removal into a kind of real-time brand callout. “It’s exciting to imagine a future where you control the physical content you see,” Spanhove posted on X (formerly Twitter). In follow-up replies, he hinted at additional features, including options to replace the red square with personal photos or text from a notes app. Check it out below – Combines Snap and Google tools The app relies on Snap’s Depth Cache API to register objects in 3D space and maintain spatial consistency as the user moves. Gemini, Google’s generative AI model, identifies the ads themselves, whether on large posters, newspaper pages, or food packaging. This allows the blocker to function beyond obvious signage. In demo clips shared by Spanhove, it successfully covers ads on cereal boxes, magazines, and public signage, though not without a delay of a second or two. The red overlays appear to float stably, following head movements and perspective shifts with accuracy. Still, it’s early days. Spanhove describes the software as “experimental,” and the user experience reflects that. Because Snap Spectacles use transparent displays, the overlays can’t fully block light, so the original ad sometimes faintly shows through. Also, the Spectacles’ narrow 46-degree field of view limits coverage to only what’s directly ahead. Design stirs debate The app has sparked strong reactions online. Many praised the concept of user-controlled visual space, while others criticized the bold red boxes as more jarring than the ads themselves. One suggestion, from user Hexographer ⬣Backup account⬣, proposed replacing the red blocks with more visually pleasing alternatives, such as “images of local foliage or animal life.” They also suggested that users could set a custom folder of replacement visuals, including personal or family photos. Others asked for cross-platform support, but the app currently only works with Snap Spectacles. Devices like the Apple Vision Pro or Meta Quest will need separate development efforts. Despite its limitations, the project arrives at a moment when major tech firms like Meta and Microsoft have scaled back their AR ambitions. Snap, meanwhile, continues renting its Spectacles to developers at $99 per month, making experiments like Spanhove’s possible. Read more:

Owen Gregorian

45,774 次观看 • 11 个月前

Transform collaboration, training, and visualization with immersive enterprise AR solutions. Break through physical barriers to boost productivity and drive innovation with AR technology.
2:33

Transform collaboration, training, and visualization with immersive enterprise AR solutions. Break through physical barriers to boost productivity and drive innovation with AR technology.

Magic Leap

1,712,314 次观看 • 3 年前

Apple Vision Pro’s AirDraw app converts 3D drawings into physical objects
0:39

Apple Vision Pro’s AirDraw app converts 3D drawings into physical objects

Apple Design

1,061,946 次观看 • 4 个月前

Build edge AI applications with Google tools using Hybrid LLMs. Learn how to combine the on-device capabilities of Gemma and cloud-based Gemini models for optimal performance and privacy.
4:00

Build edge AI applications with Google tools using Hybrid LLMs. Learn how to combine the on-device capabilities of Gemma and cloud-based Gemini models for optimal performance and privacy.

Google AI Developers

15,365 次观看 • 1 年前

imagine a world where geospatial AI, VPS, and AR glasses meet. we’re actively exploring the magic of what that looks like with Dots as spatially intelligent agents for navigation. cc: Spectacles Peridot Niantic Spatial 🌎 ICYMI, we also announced our multi-year strategic partnership, including an investment from Snap Inc., to build the next-gen AI-powered map of the real world.
1:14

imagine a world where geospatial AI, VPS, and AR glasses meet. we’re actively exploring the magic of what that looks like with Dots as spatially intelligent agents for navigation. cc: Spectacles Peridot Niantic Spatial 🌎 ICYMI, we also announced our multi-year strategic partnership, including an investment from Snap Inc., to build the next-gen AI-powered map of the real world.

asim ᯅ

51,901 次观看 • 1 年前

Empower powerful research and content creation with our new multimodal Gemini 2.5 researcher, built together with LangChain.
14:03

Empower powerful research and content creation with our new multimodal Gemini 2.5 researcher, built together with LangChain.

Google AI Developers

63,325 次观看 • 11 个月前