正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

What if you could talk to your Telegram bot and it actually talked back? Learn how built a voice-enabled Telegram bot with the Gemini Interactions API in ~400 lines of Python. Send a voice note in any language, Gemini understands the audio and replies with text and a spoken... show more

Philipp Schmid

82,987 subscribers

11,156 次观看 • 4 个月前 •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 条评论

暂无评论

原始帖子的评论将显示在这里

相关视频

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

Google for Developers

15,402 次观看 • 4 个月前

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Logan Kilpatrick

805,356 次观看 • 4 个月前

Audio Transcription with Google Gemini 1.5 Flash In this video, Gemini-Flash was able to transcribe 13 minutes of audio in 50-60 seconds. I have tested this with multiple audio files, and the transcription accuracy is close to 99%. If the audio is clear, you get 100% correct transcription. Even if the audio is really bad with a lot of noise, you still get around 95-96% accuracy. The code for this is available on GitHub. If you're interested, you can download and run it. You just need a Google API key.

Audio Transcription with Google Gemini 1.5 Flash In this video, Gemini-Flash was able to transcribe 13 minutes of audio in 50-60 seconds. I have tested this with multiple audio files, and the transcription accuracy is close to 99%. If the audio is clear, you get 100% correct transcription. Even if the audio is really bad with a lot of noise, you still get around 95-96% accuracy. The code for this is available on GitHub. If you're interested, you can download and run it. You just need a Google API key.

AshutoshShrivastava

122,990 次观看 • 1 年前

Released today: Gemini 3.1 Flash TTS 🔊 A text-to-speech model you actually direct. Add [whispers] and it whispers. Add [shouting] and it shouts. Mid-sentence. eg. "[asmr] Hey there, [deep and loud] TURN THIS UP, [asmr] how can I help you?" Now available in Google AI Studio & Gemini API.

Released today: Gemini 3.1 Flash TTS 🔊 A text-to-speech model you actually direct. Add [whispers] and it whispers. Add [shouting] and it shouts. Mid-sentence. eg. "[asmr] Hey there, [deep and loud] TURN THIS UP, [asmr] how can I help you?" Now available in Google AI Studio & Gemini API.

Philipp Schmid

118,138 次观看 • 4 个月前

introducing Gemini 3.5 Transcribe: our most precise speech-to-text model yet, designed for intelligent voice interactions this new model: - seamlessly handles self-corrections - removes filler words to deliver clean, formatted text - understands your natural intent and speaking style - captures audio, even in noisy environments - supports 85+ languages, including regional accents and diverse dialects try it today in the Gemini API and in AI Studio

introducing Gemini 3.5 Transcribe: our most precise speech-to-text model yet, designed for intelligent voice interactions this new model: - seamlessly handles self-corrections - removes filler words to deliver clean, formatted text - understands your natural intent and speaking style - captures audio, even in noisy environments - supports 85+ languages, including regional accents and diverse dialects try it today in the Gemini API and in AI Studio

Google AI Studio

236,640 次观看 • 14 天前

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,094,122 次观看 • 9 个月前

Meet Veo 3.1 👋 With Veo 3.1, you can generate videos with richer audio, better narrative control, and enhanced realism. This new update also comes with a suite of additional features built for creative control. Including the ability to: — Extend your videos to make them longer (with audio) — Set the first and last frame of your video to control your output (with audio) — Upload multiple ingredient images to craft your scene (with audio) — Add or remove objects directly in your video These features are available in Flow by Google, the Gemini API, and Google Cloud Vertex AI. Veo 3.1 is also available in the Google Gemini. We’re so excited to see what you create!

Meet Veo 3.1 👋 With Veo 3.1, you can generate videos with richer audio, better narrative control, and enhanced realism. This new update also comes with a suite of additional features built for creative control. Including the ability to: — Extend your videos to make them longer (with audio) — Set the first and last frame of your video to control your output (with audio) — Upload multiple ingredient images to craft your scene (with audio) — Add or remove objects directly in your video These features are available in Flow by Google, the Gemini API, and Google Cloud Vertex AI. Veo 3.1 is also available in the Google Gemini. We’re so excited to see what you create!

Google AI

71,238 次观看 • 10 个月前

I just built a Voice AI Agent for insurance claims using Gemini 3.1 Flash Live and Google ADK. Talk to it. It fills the intake form, extracts claim details, and routes to an adjuster in real-time. 100% Opensource.

I just built a Voice AI Agent for insurance claims using Gemini 3.1 Flash Live and Google ADK. Talk to it. It fills the intake form, extracts claim details, and routes to an adjuster in real-time. 100% Opensource.

Shubham Saboo

73,280 次观看 • 4 个月前

Gemini 3.1 Flash-Lite is the model to build always on multimodal AI Agents. I just built a memory agent with Google ADK that runs 24/7. Feed it text, images, audio, video or PDFs. It reads, connects and consolidates everything while you sleep. 100% Opensource code.

Gemini 3.1 Flash-Lite is the model to build always on multimodal AI Agents. I just built a memory agent with Google ADK that runs 24/7. Feed it text, images, audio, video or PDFs. It reads, connects and consolidates everything while you sleep. 100% Opensource code.

Shubham Saboo

24,930 次观看 • 6 个月前

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.

Philipp Schmid

21,769 次观看 • 3 个月前

🗣️✨ Speak your vibes into existence with Gemini 3.5 Transcribe The latest audio model is built for apps that need live transcription and quick visual prototyping. Watch genevieveh@ turn spoken ideas into a dynamic mood board using Gemini 3.5 Transcribe on the Live API. The model maps speech to user intent to create prompts that trigger live image generation and editing with Nano Banana 2 Lite:

🗣️✨ Speak your vibes into existence with Gemini 3.5 Transcribe The latest audio model is built for apps that need live transcription and quick visual prototyping. Watch genevieveh@ turn spoken ideas into a dynamic mood board using Gemini 3.5 Transcribe on the Live API. The model maps speech to user intent to create prompts that trigger live image generation and editing with Nano Banana 2 Lite:

Google for Developers

34,534 次观看 • 12 天前

Second, using 3.1 Flash-Lite in Google AI Studio, we built a retail business agent that plans and executes multi-step tasks for you like reporting and dashboard automation - saving you time to focus on the things that matter most. Beginning today, the model is rolling out in preview via the Gemini API in Google AI Studio and Vertex AI. Try it out and let us know what you think.

Second, using 3.1 Flash-Lite in Google AI Studio, we built a retail business agent that plans and executes multi-step tasks for you like reporting and dashboard automation - saving you time to focus on the things that matter most. Beginning today, the model is rolling out in preview via the Gemini API in Google AI Studio and Vertex AI. Try it out and let us know what you think.

Google AI

23,419 次观看 • 6 个月前

With this new release, Gemini applies advanced reasoning to make sense of complex, changing information in real-time. 3.1 Pro can utilize advanced reasoning to bridge the gap between complex APIs and user-friendly design. For example, Gemini built a live aerospace dashboard, taking live telemetry from a public API and designing a front end to track the Space Station's orbit.

With this new release, Gemini applies advanced reasoning to make sense of complex, changing information in real-time. 3.1 Pro can utilize advanced reasoning to bridge the gap between complex APIs and user-friendly design. For example, Gemini built a live aerospace dashboard, taking live telemetry from a public API and designing a front end to track the Space Station's orbit.

Google Gemini

106,360 次观看 • 6 个月前

Today, we’re launching Gemini 3.5 Transcribe, our new speech-to-text model with sub-second streaming and intelligent post-processing for agent interfaces. 2.6% WER on non-streaming and 4.0% on streaming. Supports 85+ languages, cleans up conversational disfluencies ("um", "ah", and mid-sentence self-corrections), handles alphanumeric tokens (postal codes or IDs), 70% reduction time for the final transcription compared to Chirp 3. - `gemini-3.5-transcribe-live`: Sub-second, bidirectional streaming via the Gemini Live API - `gemini-3.5-transcribe`: Recorded processing via the Interactions API with word-level timestamps and speaker attribution (up to 3 speakers). Having access to Transcribe has made me use voice input way more than I ever did before. The native post-processing is incredible. It knows you mean `.json` and not a person named "Jason". I sometimes speak 5 minutes into and it perfectly refactors my instruction to my context. Available today in public preview in Gemini API, Google AI Studio and already in the Google Gemini and Google Antigravity. Try here:

Today, we’re launching Gemini 3.5 Transcribe, our new speech-to-text model with sub-second streaming and intelligent post-processing for agent interfaces. 2.6% WER on non-streaming and 4.0% on streaming. Supports 85+ languages, cleans up conversational disfluencies ("um", "ah", and mid-sentence self-corrections), handles alphanumeric tokens (postal codes or IDs), 70% reduction time for the final transcription compared to Chirp 3. - `gemini-3.5-transcribe-live`: Sub-second, bidirectional streaming via the Gemini Live API - `gemini-3.5-transcribe`: Recorded processing via the Interactions API with word-level timestamps and speaker attribution (up to 3 speakers). Having access to Transcribe has made me use voice input way more than I ever did before. The native post-processing is incredible. It knows you mean `.json` and not a person named "Jason". I sometimes speak 5 minutes into and it perfectly refactors my instruction to my context. Available today in public preview in Gemini API, Google AI Studio and already in the Google Gemini and Google Antigravity. Try here:

Philipp Schmid

15,084 次观看 • 14 天前

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Google AI

203,281 次观看 • 4 个月前

Today we’re introducing Gemini 3.5 Transcribe, our latest transcription model built for incredibly precise, smart dictation across your favorite apps and devices. Remember when traditional speech-to-text meant shouting over background noise, constantly hitting backspace to fix misspelled words, and manually deleting every "um" and "uh"? Those days are over. Gemini 3.5 Transcribe isn't just dictation — it’s active intelligence with precise, context-aware speech-to-text support in 85+ languages. The model automatically filters out filler words, formats unstructured speech, and even pairs with your screen context to execute voice commands. Watch as Gemini 3.5 Transcribe removes filler words and uses multimodal capabilities to seamlessly turn messy voice input and local files into a polished email draft.

Today we’re introducing Gemini 3.5 Transcribe, our latest transcription model built for incredibly precise, smart dictation across your favorite apps and devices. Remember when traditional speech-to-text meant shouting over background noise, constantly hitting backspace to fix misspelled words, and manually deleting every "um" and "uh"? Those days are over. Gemini 3.5 Transcribe isn't just dictation — it’s active intelligence with precise, context-aware speech-to-text support in 85+ languages. The model automatically filters out filler words, formats unstructured speech, and even pairs with your screen context to execute voice commands. Watch as Gemini 3.5 Transcribe removes filler words and uses multimodal capabilities to seamlessly turn messy voice input and local files into a polished email draft.

Google AI

114,291 次观看 • 14 天前

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.

Google Gemini

2,481,254 次观看 • 8 个月前

From a single voice prompt to a deployed, real-time AI app in minutes. Watch Thor demonstrate the power of Google AI Studio: 1️⃣ Builds a multilingual interview simulator using Gemini 3.1 Flash Live. 2️⃣ Deploy it instantly to the web via Google Cloud Run. 3️⃣ Remixes it into a customer support agent with PDF knowledge docs. Ready to start your vibe coding journey? Build, remix, and check out the gallery at

From a single voice prompt to a deployed, real-time AI app in minutes. Watch Thor demonstrate the power of Google AI Studio: 1️⃣ Builds a multilingual interview simulator using Gemini 3.1 Flash Live. 2️⃣ Deploy it instantly to the web via Google Cloud Run. 3️⃣ Remixes it into a customer support agent with PDF knowledge docs. Ready to start your vibe coding journey? Build, remix, and check out the gallery at

Google for Developers

10,642 次观看 • 3 个月前

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️

Philipp Schmid

105,308 次观看 • 1 年前

The voice-to-voice AI Pareto frontier. (You'll never believe this one weird trick ...) If you're building conversational voice AI apps, you care a lot about: ➟ Latency ➟ Cost ➟ LLM response quality (predictable behavior, coverage of the full surface area of your needs, reliable function calling, "reasoning") ➟ Voice quality (correct pronunciations, consistent tone, appropriate affect, steerability, "human-ness") AI model performance is a jagged frontier and has been moving fast for all of 2024. This is especially true for conversational voice, because you're usually using several models in combination. LLMs with native audio capabilities are the newest evolution pushing the performance frontier. Here's a multi-lingual voice conversation using Gemini Flash 1.5's native audio input. But there's a problem ...

The voice-to-voice AI Pareto frontier. (You'll never believe this one weird trick ...) If you're building conversational voice AI apps, you care a lot about: ➟ Latency ➟ Cost ➟ LLM response quality (predictable behavior, coverage of the full surface area of your needs, reliable function calling, "reasoning") ➟ Voice quality (correct pronunciations, consistent tone, appropriate affect, steerability, "human-ness") AI model performance is a jagged frontier and has been moving fast for all of 2024. This is especially true for conversational voice, because you're usually using several models in combination. LLMs with native audio capabilities are the newest evolution pushing the performance frontier. Here's a multi-lingual voice conversation using Gemini Flash 1.5's native audio input. But there's a problem ...

kwindla

23,592 次观看 • 1 年前