Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓

Google DeepMind

1,123,391 subscribers

116,596 views • 1 year ago •via X (Twitter)

Science & Technology

Anya Rossi• Live Now

Private livecam show

9 Comments

AI Leaks and News1 year ago

Incredible stuff

Maurus Balmer1 year ago

Nice ..as I can SEE. 🙂 🙂🙂 - - "AI" "REASONING" "HEARING" "VISION" ...

Sid Bharath1 year ago

Can't wait to see what people build with it. I've been trying it out for some interesting use cases today -

Jason Mark Dube'1 year ago

phenomenal

Pablo Pablo1 year ago

Real-time audio and video streaming? The possibilities are endless! ⚡

Avinash Bellam1 year ago

@Google Google gemini is not working in Android version to generate images and what the reality is going on present

Aziz Mejri1 year ago

already answered better than 1.5 PRO

Rocco Sassani1 year ago

Amazing tool. $GOOGL

BrainBird1 year ago

Exciting! Can't wait to see the creations!

Related Videos

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.

Google AI Developers

27,676 views • 1 year ago

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.

Google AI Developers

18,239 views • 5 days ago

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev

Roblox

228,232 views • 2 years ago

Can AI chain tools together to complete complex tasks in real-time? Gemini 2.0 can. Here's a React demo using the new Multimodal Live API to chain code execution + real-time Google Search. I'm amazed at how fast this is.

Can AI chain tools together to complete complex tasks in real-time? Gemini 2.0 can. Here's a React demo using the new Multimodal Live API to chain code execution + real-time Google Search. I'm amazed at how fast this is.

Addy Osmani

17,782 views • 1 year ago

Welcome to the world, Gemini 2.0 ✨ our most capable AI model yet. We're first releasing an experimental version of 2.0 Flash ⚡ It has better performance, new multimodal output, Google tool use - and paves the way for new agentic experiences. 🧵

Welcome to the world, Gemini 2.0 ✨ our most capable AI model yet. We're first releasing an experimental version of 2.0 Flash ⚡ It has better performance, new multimodal output, Google tool use - and paves the way for new agentic experiences. 🧵

Google DeepMind

365,197 views • 1 year ago

Imagine integrating instant video dubbing into your app. With the Gemini API, now you can. Watch Gemini 3.5 Live Translate process speech-to-speech in near real-time, streaming translated audio directly from a video source - going from English to Hindi in seconds! 🔥 📺 Full video:

Imagine integrating instant video dubbing into your app. With the Gemini API, now you can. Watch Gemini 3.5 Live Translate process speech-to-speech in near real-time, streaming translated audio directly from a video source - going from English to Hindi in seconds! 🔥 📺 Full video:

Google for Developers

12,730 views • 7 days ago

Last week we brought voice to Stitch powered by the Gemini Live API. Today, the team announced Gemini 3.1 Flash Live and we are very excited! 🚀 We believe that your voice will be the future driver of design. Huge congrats on the updates to latency, instruction following, and natural dialogue. 👀

Last week we brought voice to Stitch powered by the Gemini Live API. Today, the team announced Gemini 3.1 Flash Live and we are very excited! 🚀 We believe that your voice will be the future driver of design. Huge congrats on the updates to latency, instruction following, and natural dialogue. 👀

Stitch by Google

41,308 views • 2 months ago

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

Google AI Developers

25,739 views • 1 year ago

Gemini 2.0 drops the beat. Watch the video all the way through — I had four legit "no way it did that" reactions when Jon Taylor sent this to me. "It looks like it's only hitting on the first beat of each bar." This is Jon collaborating with Gemini to create a song in Ableton Live. Jon is using the Multimodal Live API to stream audio and video to Gemini and have a conversation about the song he's creating.

Gemini 2.0 drops the beat. Watch the video all the way through — I had four legit "no way it did that" reactions when Jon Taylor sent this to me. "It looks like it's only hitting on the first beat of each bar." This is Jon collaborating with Gemini to create a song in Ableton Live. Jon is using the Multimodal Live API to stream audio and video to Gemini and have a conversation about the song he's creating.

kwindla

86,077 views • 1 year ago

Multimodal Real-Time Agents will be the future! 💯 Here is an early demo from what i am currently building! It uses Live API with Google DeepMind Gemini 2.0 Flash and React. Code will be open-source soon with a blog post on how to build your own Real-Time Agents! 🚀

Multimodal Real-Time Agents will be the future! 💯 Here is an early demo from what i am currently building! It uses Live API with Google DeepMind Gemini 2.0 Flash and React. Code will be open-source soon with a blog post on how to build your own Real-Time Agents! 🚀

Philipp Schmid

27,385 views • 1 year ago

Talk to Gemini on your phone ... Deploy your own Gemini Multimodal Live voice agent that you can call on the phone (or that can call you) in 5 minutes.

Talk to Gemini on your phone ... Deploy your own Gemini Multimodal Live voice agent that you can call on the phone (or that can call you) in 5 minutes.

kwindla

38,680 views • 1 year ago

Introducing Gemini Cursor ✨ – a second multimodal AI cursor for your desktop that's open-source and free! Link below 👇 This experiment 🧪 reimagines how we interact with our computers because visual cues 👀 help us make sense of what we see on a screen. In this demo, I had my friend test it out by trying to add a payment method 💳 to Amazon. The cursor walks through the entire process 💬 while talking and pointing 🖱️ to the right parts of the website. Powered by Gemini 2.0 Flash (Experimental)⚡ from Google and their live multimodal API. Shoutout to Alexander Chen for sharing the starter code that powers most of this app 🙌🔥

Introducing Gemini Cursor ✨ – a second multimodal AI cursor for your desktop that's open-source and free! Link below 👇 This experiment 🧪 reimagines how we interact with our computers because visual cues 👀 help us make sense of what we see on a screen. In this demo, I had my friend test it out by trying to add a payment method 💳 to Amazon. The cursor walks through the entire process 💬 while talking and pointing 🖱️ to the right parts of the website. Powered by Gemini 2.0 Flash (Experimental)⚡ from Google and their live multimodal API. Shoutout to Alexander Chen for sharing the starter code that powers most of this app 🙌🔥

Sriraam

171,611 views • 1 year ago

Unleash multimodal AI like never before 🔥 The new real-time vision agent built with Gemini 3.1 Flash Live API sees, hears, speaks, and creates music. Get the technical deep dive:

Unleash multimodal AI like never before 🔥 The new real-time vision agent built with Gemini 3.1 Flash Live API sees, hears, speaks, and creates music. Get the technical deep dive:

Google for Developers

13,015 views • 1 month ago

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing

Google AI Developers

24,239 views • 10 months ago

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,091,693 views • 6 months ago

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

Google for Developers

15,402 views • 2 months ago

We're excited to announce Stream's new Video API, which is now available for general use! 🎥🚀 The video API aims to make it easier for developers to build live in-app video calling, audio rooms, and live streaming. 🎧 During our eight-month beta program, our team worked closely with several companies to help integrate, test, and develop our API and SDKs. Learn more here:

We're excited to announce Stream's new Video API, which is now available for general use! 🎥🚀 The video API aims to make it easier for developers to build live in-app video calling, audio rooms, and live streaming. 🎧 During our eight-month beta program, our team worked closely with several companies to help integrate, test, and develop our API and SDKs. Learn more here:

Stream

134,124 views • 2 years ago