Загрузка видео...

Не удалось загрузить видео

На главную

What if you could talk to your Telegram bot and it actually talked back? Learn how built a voice-enabled Telegram bot with the Gemini Interactions API in ~400 lines of Python. Send a voice note in any language, Gemini understands the audio and replies with text and a spoken...

_philschmid's profile picture

Philipp Schmid

82,987 subscribers

11,156 просмотров • 3 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 0

Нет доступных комментариев

Здесь появятся комментарии из оригинального поста

Похожие видео

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:
1:10

🎙️ Build a smarter, voice-enabled Telegram bot! Our new tutorial shows you how to leverage Gemini 3.1 Flash-Lite and the Interactions API for async voice messaging, transcription, and translation. Ready to get building? Dive into the how-to:

Google for Developers

15,402 просмотров • 3 месяцев назад

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!
0:33

Introducing Gemini 3.1 Flash TTS 🗣️, our latest text to speech model with scene direction, speaker level specificity, audio tags, more natural + expressive voices, and support for 70 different languages. Available via our new audio playground in AI Studio and in the Gemini API!

Logan Kilpatrick

802,198 просмотров • 3 месяцев назад

Audio Transcription with Google Gemini 1.5 Flash In this video, Gemini-Flash was able to transcribe 13 minutes of audio in 50-60 seconds. I have tested this with multiple audio files, and the transcription accuracy is close to 99%. If the audio is clear, you get 100% correct transcription. Even if the audio is really bad with a lot of noise, you still get around 95-96% accuracy. The code for this is available on GitHub. If you're interested, you can download and run it. You just need a Google API key.
0:33

Audio Transcription with Google Gemini 1.5 Flash In this video, Gemini-Flash was able to transcribe 13 minutes of audio in 50-60 seconds. I have tested this with multiple audio files, and the transcription accuracy is close to 99%. If the audio is clear, you get 100% correct transcription. Even if the audio is really bad with a lot of noise, you still get around 95-96% accuracy. The code for this is available on GitHub. If you're interested, you can download and run it. You just need a Google API key.

AshutoshShrivastava

122,990 просмотров • 1 год назад

Released today: Gemini 3.1 Flash TTS 🔊 A text-to-speech model you actually direct. Add [whispers] and it whispers. Add [shouting] and it shouts. Mid-sentence. eg. "[asmr] Hey there, [deep and loud] TURN THIS UP, [asmr] how can I help you?" Now available in Google AI Studio & Gemini API.
0:33

Released today: Gemini 3.1 Flash TTS 🔊 A text-to-speech model you actually direct. Add [whispers] and it whispers. Add [shouting] and it shouts. Mid-sentence. eg. "[asmr] Hey there, [deep and loud] TURN THIS UP, [asmr] how can I help you?" Now available in Google AI Studio & Gemini API.

Philipp Schmid

118,138 просмотров • 3 месяцев назад

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations
2:50

Listen up 🔊 We’ve made some updates to our Gemini Audio models and capabilities: — Gemini’s live speech-to-speech translation capability is rolling out in a beta experience to the Google Translate app, bringing you real-time audio translation that captures the nuance of human speech — Gemini 2.5 Flash and 2.5 Pro Text-to-Speech preview models bring improved adherence to style prompts, precision pacing with context-aware speed adjustments, and character voice consistency for multi-speaker scenarios — Gemini 2.5 Flash Native Audio is now updated, with improvements to handle complex workflows, navigate user instructions, and hold natural conversations

Google AI

1,092,358 просмотров • 7 месяцев назад

Meet Veo 3.1 👋 With Veo 3.1, you can generate videos with richer audio, better narrative control, and enhanced realism. This new update also comes with a suite of additional features built for creative control. Including the ability to: — Extend your videos to make them longer (with audio) — Set the first and last frame of your video to control your output (with audio) — Upload multiple ingredient images to craft your scene (with audio) — Add or remove objects directly in your video These features are available in Flow by Google, the Gemini API, and Google Cloud Vertex AI. Veo 3.1 is also available in the Google Gemini. We’re so excited to see what you create!
0:34

Meet Veo 3.1 👋 With Veo 3.1, you can generate videos with richer audio, better narrative control, and enhanced realism. This new update also comes with a suite of additional features built for creative control. Including the ability to: — Extend your videos to make them longer (with audio) — Set the first and last frame of your video to control your output (with audio) — Upload multiple ingredient images to craft your scene (with audio) — Add or remove objects directly in your video These features are available in Flow by Google, the Gemini API, and Google Cloud Vertex AI. Veo 3.1 is also available in the Google Gemini. We’re so excited to see what you create!

Google AI

71,238 просмотров • 9 месяцев назад

I just built a Voice AI Agent for insurance claims using Gemini 3.1 Flash Live and Google ADK. Talk to it. It fills the intake form, extracts claim details, and routes to an adjuster in real-time. 100% Opensource.
2:04

I just built a Voice AI Agent for insurance claims using Gemini 3.1 Flash Live and Google ADK. Talk to it. It fills the intake form, extracts claim details, and routes to an adjuster in real-time. 100% Opensource.

Shubham Saboo

71,757 просмотров • 2 месяцев назад

Gemini 3.1 Flash-Lite is the model to build always on multimodal AI Agents. I just built a memory agent with Google ADK that runs 24/7. Feed it text, images, audio, video or PDFs. It reads, connects and consolidates everything while you sleep. 100% Opensource code.
1:05

Gemini 3.1 Flash-Lite is the model to build always on multimodal AI Agents. I just built a memory agent with Google ADK that runs 24/7. Feed it text, images, audio, video or PDFs. It reads, connects and consolidates everything while you sleep. 100% Opensource code.

Shubham Saboo

24,930 просмотров • 4 месяцев назад

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.
23:49

What if you can build an Agent with it own computer in a single api call? At my Google I/O talk, I showed how to use Gemini Managed Agents and the new Interactions API to give your AI a secure, hosted Linux sandbox to execute code and manage its own memory.

Philipp Schmid

21,726 просмотров • 1 месяц назад

Second, using 3.1 Flash-Lite in Google AI Studio, we built a retail business agent that plans and executes multi-step tasks for you like reporting and dashboard automation - saving you time to focus on the things that matter most. Beginning today, the model is rolling out in preview via the Gemini API in Google AI Studio and Vertex AI. Try it out and let us know what you think.
0:50

Second, using 3.1 Flash-Lite in Google AI Studio, we built a retail business agent that plans and executes multi-step tasks for you like reporting and dashboard automation - saving you time to focus on the things that matter most. Beginning today, the model is rolling out in preview via the Gemini API in Google AI Studio and Vertex AI. Try it out and let us know what you think.

Google AI

23,374 просмотров • 4 месяцев назад

With this new release, Gemini applies advanced reasoning to make sense of complex, changing information in real-time. 3.1 Pro can utilize advanced reasoning to bridge the gap between complex APIs and user-friendly design. For example, Gemini built a live aerospace dashboard, taking live telemetry from a public API and designing a front end to track the Space Station's orbit.
0:25

With this new release, Gemini applies advanced reasoning to make sense of complex, changing information in real-time. 3.1 Pro can utilize advanced reasoning to bridge the gap between complex APIs and user-friendly design. For example, Gemini built a live aerospace dashboard, taking live telemetry from a public API and designing a front end to track the Space Station's orbit.

Google Gemini

106,360 просмотров • 4 месяцев назад

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓
1:14

Today we launched Gemini 3.1 Flash TTS, our most expressive and controllable text-to-speech model yet. This launch [excitement] includes audio tags! 🗣🏷 Audio tags [explanatory] are a seamless way to guide vocal style, pace, and delivery using natural language commands embedded directly in your text. Want a different tempo or tone? [amazement] Just tag the audio to steer the AI-speech output! The model supports 70+ languages (24 of which are high-quality evaluated languages, including: Japanese, Hindi, and Arabic). Watch the audio tags in action in the demo below ↓

Google AI

202,556 просмотров • 3 месяцев назад

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.
1:03

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.

Google Gemini

2,481,254 просмотров • 7 месяцев назад

From a single voice prompt to a deployed, real-time AI app in minutes. Watch Thor demonstrate the power of Google AI Studio: 1️⃣ Builds a multilingual interview simulator using Gemini 3.1 Flash Live. 2️⃣ Deploy it instantly to the web via Google Cloud Run. 3️⃣ Remixes it into a customer support agent with PDF knowledge docs. Ready to start your vibe coding journey? Build, remix, and check out the gallery at
1:13

From a single voice prompt to a deployed, real-time AI app in minutes. Watch Thor demonstrate the power of Google AI Studio: 1️⃣ Builds a multilingual interview simulator using Gemini 3.1 Flash Live. 2️⃣ Deploy it instantly to the web via Google Cloud Run. 3️⃣ Remixes it into a customer support agent with PDF knowledge docs. Ready to start your vibe coding journey? Build, remix, and check out the gallery at

Google for Developers

10,642 просмотров • 1 месяц назад

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️
0:52

Gemini 2.5 Flash can control a browser! Excited to share Gemini Browser Agent, a simple Python script example on how to use Google DeepMind Gemini 2.5 Flash and Browser Use to act as general assistant! 🤯 Usage Examples: 1⃣ Single Query Mode: `python scripts/gemini-browser-use.py --url --query "Summarize the key features of Gemini 2.5 Flash."` 2⃣Interactive Mode: Start an interactive session, optionally with a starting URL. `python scripts/gemini-browser-use.py` Command-line options: --model: The Gemini model to use (default: gemini-2.5-flash-preview-04-17) --headless: Run the browser in headless mode --url: Starting URL for the browser to navigate to before processing the query --query: Run a single query and exit (instead of interactive mode) Time to build a replication of Manus and OpenAI Operator powered by Gemini 2.5. Code below ⬇️

Philipp Schmid

105,308 просмотров • 1 год назад

The voice-to-voice AI Pareto frontier. (You'll never believe this one weird trick ...) If you're building conversational voice AI apps, you care a lot about: ➟ Latency ➟ Cost ➟ LLM response quality (predictable behavior, coverage of the full surface area of your needs, reliable function calling, "reasoning") ➟ Voice quality (correct pronunciations, consistent tone, appropriate affect, steerability, "human-ness") AI model performance is a jagged frontier and has been moving fast for all of 2024. This is especially true for conversational voice, because you're usually using several models in combination. LLMs with native audio capabilities are the newest evolution pushing the performance frontier. Here's a multi-lingual voice conversation using Gemini Flash 1.5's native audio input. But there's a problem ...
1:01

The voice-to-voice AI Pareto frontier. (You'll never believe this one weird trick ...) If you're building conversational voice AI apps, you care a lot about: ➟ Latency ➟ Cost ➟ LLM response quality (predictable behavior, coverage of the full surface area of your needs, reliable function calling, "reasoning") ➟ Voice quality (correct pronunciations, consistent tone, appropriate affect, steerability, "human-ness") AI model performance is a jagged frontier and has been moving fast for all of 2024. This is especially true for conversational voice, because you're usually using several models in combination. LLMs with native audio capabilities are the newest evolution pushing the performance frontier. Here's a multi-lingual voice conversation using Gemini Flash 1.5's native audio input. But there's a problem ...

kwindla

23,592 просмотров • 1 год назад

VoiceBox just did what everyone thought was impossible. It might have killed ElevenLabs overnight. No subscription. No cloud. No credits. Runs locally on your machine. Clones a voice from 3 seconds of audio. Powered by Qwen 3 TTS. Apache 2.0 license. Commercial use allowed. And your voice data never leaves your computer. For years, if you wanted high quality voice cloning, ElevenLabs was the default. Now there’s a free open-source alternative that sounds shockingly close. Plus it has a built-in multi-track editor, recording, transcription with Whisper, and a local API. This isn’t just another TTS tool. It’s a full voice production studio on your desktop. Open source AI is catching up fast. And this changes the game for creators and businesses. Would you trust the cloud with your voice… or keep it local? 👇
8:20

VoiceBox just did what everyone thought was impossible. It might have killed ElevenLabs overnight. No subscription. No cloud. No credits. Runs locally on your machine. Clones a voice from 3 seconds of audio. Powered by Qwen 3 TTS. Apache 2.0 license. Commercial use allowed. And your voice data never leaves your computer. For years, if you wanted high quality voice cloning, ElevenLabs was the default. Now there’s a free open-source alternative that sounds shockingly close. Plus it has a built-in multi-track editor, recording, transcription with Whisper, and a local API. This isn’t just another TTS tool. It’s a full voice production studio on your desktop. Open source AI is catching up fast. And this changes the game for creators and businesses. Would you trust the cloud with your voice… or keep it local? 👇

Julian Goldie SEO

59,167 просмотров • 4 месяцев назад

If your contracts don’t fit in a prompt window, your AI has to work at document scale. See how Google’s Gemini 3 Pro + Box AI API extract contract metadata and run multi-file risk analysis with the Box AI Ask API using your own governance docs.
8:40

If your contracts don’t fit in a prompt window, your AI has to work at document scale. See how Google’s Gemini 3 Pro + Box AI API extract contract metadata and run multi-file risk analysis with the Box AI Ask API using your own governance docs.

Box

30,545 просмотров • 8 месяцев назад

I tested Gemini 3.1 Flash Live and one thing stood out immediately: the speed. You ask a question. It answers almost instantly. No awkward delay. No clunky back-and-forth. Then it gets more interesting. You can: use voice mode, use webcam mode, share your screen, connect tools, add system instructions, and publish the app to the cloud. So this is not just “voice chat with AI.” It is the beginning of real-time AI agents you can actually ship.
18:11

I tested Gemini 3.1 Flash Live and one thing stood out immediately: the speed. You ask a question. It answers almost instantly. No awkward delay. No clunky back-and-forth. Then it gets more interesting. You can: use voice mode, use webcam mode, share your screen, connect tools, add system instructions, and publish the app to the cloud. So this is not just “voice chat with AI.” It is the beginning of real-time AI agents you can actually ship.

Julian Goldie SEO

21,000 просмотров • 3 месяцев назад

Better/faster/cheaper voice AI turn detection with Gemini 2.0 The code that determines when the agent should respond to the user is some of the most important code in your voice AI agent. The technical terms for this job are "turn detection" or "phrase endpointing." If the voice AI responds before the user has finished their thought, the conversation is choppy and unproductive. If the AI waits too long, the conversation is slow and frustrating. There are a number of ways to approach this. You can: 1. Use a fast "voice activity detection" model to detect pauses in speech. Respond when the user pauses. 2. Use a specialized phrase endpointing model that operates on transcribed text, pattern-matching on text semantics. 3. Train a specialized phrase endpointing model that operates directly on audio. 4. Leverage the native audio capabilities of a SOTA LLM like Gemini 2.0. We've benchmarked all four of these, and Gemini 2.0 currently beats other approaches. Using Gemini is also cheaper than transcribing the audio separately using a transcription service or model. Here's a short video showing Gemini phrase endpointing in two scenarios. First, correctly handling pauses in natural conversation. Second, requesting a phone number (which is a common activity in a use case like customer support). You can see the Completeness check lines in the terminal output, printed each time Gemini processes a chunk of audio.
1:23

Better/faster/cheaper voice AI turn detection with Gemini 2.0 The code that determines when the agent should respond to the user is some of the most important code in your voice AI agent. The technical terms for this job are "turn detection" or "phrase endpointing." If the voice AI responds before the user has finished their thought, the conversation is choppy and unproductive. If the AI waits too long, the conversation is slow and frustrating. There are a number of ways to approach this. You can: 1. Use a fast "voice activity detection" model to detect pauses in speech. Respond when the user pauses. 2. Use a specialized phrase endpointing model that operates on transcribed text, pattern-matching on text semantics. 3. Train a specialized phrase endpointing model that operates directly on audio. 4. Leverage the native audio capabilities of a SOTA LLM like Gemini 2.0. We've benchmarked all four of these, and Gemini 2.0 currently beats other approaches. Using Gemini is also cheaper than transcribing the audio separately using a transcription service or model. Here's a short video showing Gemini phrase endpointing in two scenarios. First, correctly handling pauses in natural conversation. Second, requesting a phone number (which is a common activity in a use case like customer support). You can see the Completeness check lines in the terminal output, printed each time Gemini processes a chunk of audio.

kwindla

64,184 просмотров • 1 год назад