Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓

GoogleDeepMind's profile picture

Google DeepMind

1,123,391 subscribers

116,596 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & Technologie
LIVE

Anya Rossi• Live Now

Private livecam show

9 Kommentare

Profilbild von AI Leaks and News
AI Leaks and Newsvor 1 Jahr

Incredible stuff

Profilbild von Maurus Balmer
Maurus Balmervor 1 Jahr

Nice ..as I can SEE. 🙂 🙂🙂 - - "AI" "REASONING" "HEARING" "VISION" ...

Profilbild von Sid Bharath
Sid Bharathvor 1 Jahr

Can't wait to see what people build with it. I've been trying it out for some interesting use cases today -

Profilbild von Jason Mark Dube'
Jason Mark Dube'vor 1 Jahr

phenomenal

Profilbild von Pablo Pablo
Pablo Pablovor 1 Jahr

Real-time audio and video streaming? The possibilities are endless! ⚡

Profilbild von Avinash Bellam
Avinash Bellamvor 1 Jahr

@Google Google gemini is not working in Android version to generate images and what the reality is going on present

Profilbild von Aziz Mejri
Aziz Mejrivor 1 Jahr

already answered better than 1.5 PRO

Profilbild von Rocco Sassani
Rocco Sassanivor 1 Jahr

Amazing tool. $GOOGL

Profilbild von BrainBird
BrainBirdvor 1 Jahr

Exciting! Can't wait to see the creations!

Ähnliche Videos

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.
6:53

Dive into Gemini 2.0 Flash Experimental! AI Dev Advocate, Ian Ballantyne, covers the new Multimodal Live API, native tool use, spatial reasoning and multimodal output capabilities for devs to build dynamic experiences.

Google AI Developers

27,676 Aufrufe • vor 1 Jahr

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.
0:43

Add near real-time voice translation to your apps with Gemini 3.5 Live Translate via the Gemini Live API. 🎙️ Watch how the model handles live broadcast ingestion and translation with continuous speech-to-speech streaming (S2ST) and synced transcripts, letting users tune into global radio broadcasts in their native language.

Google AI Developers

18,319 Aufrufe • vor 6 Tagen

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev
0:28

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev

Roblox

228,232 Aufrufe • vor 2 Jahren

Can AI chain tools together to complete complex tasks in real-time? Gemini 2.0 can. Here's a React demo using the new Multimodal Live API to chain code execution + real-time Google Search. I'm amazed at how fast this is.
2:17

Can AI chain tools together to complete complex tasks in real-time? Gemini 2.0 can. Here's a React demo using the new Multimodal Live API to chain code execution + real-time Google Search. I'm amazed at how fast this is.

Addy Osmani

17,782 Aufrufe • vor 1 Jahr

Welcome to the world, Gemini 2.0 ✨ our most capable AI model yet. We're first releasing an experimental version of 2.0 Flash ⚡ It has better performance, new multimodal output, Google tool use - and paves the way for new agentic experiences. 🧵
2:52

Welcome to the world, Gemini 2.0 ✨ our most capable AI model yet. We're first releasing an experimental version of 2.0 Flash ⚡ It has better performance, new multimodal output, Google tool use - and paves the way for new agentic experiences. 🧵

Google DeepMind

365,206 Aufrufe • vor 1 Jahr

Imagine integrating instant video dubbing into your app. With the Gemini API, now you can. Watch Gemini 3.5 Live Translate process speech-to-speech in near real-time, streaming translated audio directly from a video source - going from English to Hindi in seconds! 🔥 📺 Full video:
0:55

Imagine integrating instant video dubbing into your app. With the Gemini API, now you can. Watch Gemini 3.5 Live Translate process speech-to-speech in near real-time, streaming translated audio directly from a video source - going from English to Hindi in seconds! 🔥 📺 Full video:

Google for Developers

12,730 Aufrufe • vor 8 Tagen

Last week we brought voice to Stitch powered by the Gemini Live API. Today, the team announced Gemini 3.1 Flash Live and we are very excited! 🚀 We believe that your voice will be the future driver of design. Huge congrats on the updates to latency, instruction following, and natural dialogue. 👀
1:16

Last week we brought voice to Stitch powered by the Gemini Live API. Today, the team announced Gemini 3.1 Flash Live and we are very excited! 🚀 We believe that your voice will be the future driver of design. Huge congrats on the updates to latency, instruction following, and natural dialogue. 👀

Stitch by Google

41,308 Aufrufe • vor 2 Monaten

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.
0:28

🎶 Lyria RealTime is a new experimental interactive music generation model that allows anyone to interactively create, control and perform music in real time. Available via the Gemini API and you can try the demo app on Google AI Studio.

Google AI Developers

25,739 Aufrufe • vor 1 Jahr

Gemini 2.0 drops the beat. Watch the video all the way through — I had four legit "no way it did that" reactions when Jon Taylor sent this to me. "It looks like it's only hitting on the first beat of each bar." This is Jon collaborating with Gemini to create a song in Ableton Live. Jon is using the Multimodal Live API to stream audio and video to Gemini and have a conversation about the song he's creating.
4:15

Gemini 2.0 drops the beat. Watch the video all the way through — I had four legit "no way it did that" reactions when Jon Taylor sent this to me. "It looks like it's only hitting on the first beat of each bar." This is Jon collaborating with Gemini to create a song in Ableton Live. Jon is using the Multimodal Live API to stream audio and video to Gemini and have a conversation about the song he's creating.

kwindla

86,077 Aufrufe • vor 1 Jahr

Multimodal Real-Time Agents will be the future! 💯 Here is an early demo from what i am currently building! It uses Live API with Google DeepMind Gemini 2.0 Flash and React. Code will be open-source soon with a blog post on how to build your own Real-Time Agents! 🚀
1:23

Multimodal Real-Time Agents will be the future! 💯 Here is an early demo from what i am currently building! It uses Live API with Google DeepMind Gemini 2.0 Flash and React. Code will be open-source soon with a blog post on how to build your own Real-Time Agents! 🚀

Philipp Schmid

27,385 Aufrufe • vor 1 Jahr

Talk to Gemini on your phone ... Deploy your own Gemini Multimodal Live voice agent that you can call on the phone (or that can call you) in 5 minutes.
2:12

Talk to Gemini on your phone ... Deploy your own Gemini Multimodal Live voice agent that you can call on the phone (or that can call you) in 5 minutes.

kwindla

38,680 Aufrufe • vor 1 Jahr

Introducing Gemini Cursor ✨ – a second multimodal AI cursor for your desktop that's open-source and free! Link below 👇 This experiment 🧪 reimagines how we interact with our computers because visual cues 👀 help us make sense of what we see on a screen. In this demo, I had my friend test it out by trying to add a payment method 💳 to Amazon. The cursor walks through the entire process 💬 while talking and pointing 🖱️ to the right parts of the website. Powered by Gemini 2.0 Flash (Experimental)⚡ from Google and their live multimodal API. Shoutout to Alexander Chen for sharing the starter code that powers most of this app 🙌🔥
2:19

Introducing Gemini Cursor ✨ – a second multimodal AI cursor for your desktop that's open-source and free! Link below 👇 This experiment 🧪 reimagines how we interact with our computers because visual cues 👀 help us make sense of what we see on a screen. In this demo, I had my friend test it out by trying to add a payment method 💳 to Amazon. The cursor walks through the entire process 💬 while talking and pointing 🖱️ to the right parts of the website. Powered by Gemini 2.0 Flash (Experimental)⚡ from Google and their live multimodal API. Shoutout to Alexander Chen for sharing the starter code that powers most of this app 🙌🔥

Sriraam

171,611 Aufrufe • vor 1 Jahr

Unleash multimodal AI like never before 🔥 The new real-time vision agent built with Gemini 3.1 Flash Live API sees, hears, speaks, and creates music. Get the technical deep dive:
0:54

Unleash multimodal AI like never before 🔥 The new real-time vision agent built with Gemini 3.1 Flash Live API sees, hears, speaks, and creates music. Get the technical deep dive:

Google for Developers

13,015 Aufrufe • vor 1 Monat

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing
40:13

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing

Google AI Developers

24,239 Aufrufe • vor 10 Monaten

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations
2:50

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,091,693 Aufrufe • vor 6 Monaten

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:
1:10

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

Google for Developers

15,402 Aufrufe • vor 2 Monaten

We're excited to announce Stream's new Video API, which is now available for general use! 🎥🚀 The video API aims to make it easier for developers to build live in-app video calling, audio rooms, and live streaming. 🎧 During our eight-month beta program, our team worked closely with several companies to help integrate, test, and develop our API and SDKs. Learn more here:
0:30

We're excited to announce Stream's new Video API, which is now available for general use! 🎥🚀 The video API aims to make it easier for developers to build live in-app video calling, audio rooms, and live streaming. 🎧 During our eight-month beta program, our team worked closely with several companies to help integrate, test, and develop our API and SDKs. Learn more here:

Stream

134,124 Aufrufe • vor 2 Jahren