Loading video...

Video Failed to Load

Go Home

Continuing with the 3D Conversational Lab, now implementing real-time lip-sync for both the user's audio & the AI agents I'm processing the Gemini Live API native audio to make the synchronization immediate Check out the flow. Inspiration explained below...

arturitu's profile picture

Arturo Paracuellos

2,436 subscribers

18,570 views • 4 months ago •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Iterating on my 3D Conversational Lab with Google AI Studio Today, I’m taking the UX a step further by mapping emotional tone to 3D animations in real-time. Using Gemini Live API function calling, the agent now detects the tone of the chat & the characters reacts accordingly.
0:29

Iterating on my 3D Conversational Lab with Google AI Studio Today, I’m taking the UX a step further by mapping emotional tone to 3D animations in real-time. Using Gemini Live API function calling, the agent now detects the tone of the chat & the characters reacts accordingly.

Arturo Paracuellos

18,511 views • 4 months ago

Gemini 2.5 Flash Preview now supports native audio output via the Live API for seamless and natural spoken interactions. With support for 30+ voices, build conversational AI agents and experiences that feel more intuitive and natural →
0:35

Gemini 2.5 Flash Preview now supports native audio output via the Live API for seamless and natural spoken interactions. With support for 30+ voices, build conversational AI agents and experiences that feel more intuitive and natural →

Google AI Developers

23,110 views • 1 year ago

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.
1:23

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.

LiveKit

40,277 views • 2 months ago

Seedance 1.5 pro delivers native audio-visual synchronization with millisecond-precise lip sync. Dialogue, music, and sound effects stay aligned across multiple speakers and languages, reducing the need for post-production fixes.
0:42

Seedance 1.5 pro delivers native audio-visual synchronization with millisecond-precise lip sync. Dialogue, music, and sound effects stay aligned across multiple speakers and languages, reducing the need for post-production fixes.

BytePlus

15,459,960 views • 5 months ago

What will you build this weekend? 🛠️ Gemini 3.5 Live Translate is officially in Preview via the Gemini Live API and Google AI Studio! Skip the fragmented multi-model stack. Stream audio in,get translated audio out. 👇Tap the link to try it out in Google AI Studio: Start building apps:
0:30

What will you build this weekend? 🛠️ Gemini 3.5 Live Translate is officially in Preview via the Gemini Live API and Google AI Studio! Skip the fragmented multi-model stack. Stream audio in,get translated audio out. 👇Tap the link to try it out in Google AI Studio: Start building apps:

Google for Developers

13,091 views • 3 days ago

Just vibe coded with Gemini 3: an AI sparring partner to help you practice pitching skills. general chatbot is "too nice" to do that quite shocked by the low-latency audio stream by Gemini live api Google Gemini , vibe building a audio native app is no longer a dream
5:45

Just vibe coded with Gemini 3: an AI sparring partner to help you practice pitching skills. general chatbot is "too nice" to do that quite shocked by the low-latency audio stream by Gemini live api Google Gemini , vibe building a audio native app is no longer a dream

Jay Ding

12,289 views • 5 months ago

Introducing AI Voice Agents: The All-In-One Platform for Voice AI Agents and Everything Audio! 🎙 Build conversational agents, clone voices, generate sounds & engage like never before 🤖 DEMO IS LIVE: 🌱 Start farming & earn rewards!
0:54

Introducing AI Voice Agents: The All-In-One Platform for Voice AI Agents and Everything Audio! 🎙 Build conversational agents, clone voices, generate sounds & engage like never before 🤖 DEMO IS LIVE: 🌱 Start farming & earn rewards!

AI Voice Agents | AIVA

95,503 views • 1 year ago

Make some noise for React Native Audio API! 🔈 We wanted to see if we could turn a phone into a real guitar pedalboard. 🎸 Turns out, we can. 😎 Check the demo 👇
0:36

Make some noise for React Native Audio API! 🔈 We wanted to see if we could turn a phone into a real guitar pedalboard. 🎸 Turns out, we can. 😎 Check the demo 👇

Software Mansion

11,255 views • 3 months ago

React Native Audio API 0.11.0 is out! 🔊 It’s packed with tons of stability and DX improvements. We've also shipped a fully customizable recording to file and new Web Audio API nodes. Check out the demo 👇
0:22

React Native Audio API 0.11.0 is out! 🔊 It’s packed with tons of stability and DX improvements. We've also shipped a fully customizable recording to file and new Web Audio API nodes. Check out the demo 👇

Software Mansion

20,148 views • 5 months ago

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓
2:30

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓

Google DeepMind

116,596 views • 1 year ago

Introducing Sparrow-1, a conversational-flow control model built for real-time conversational video that sets the benchmark for human-level conversational timing and understanding in real-time AI.
3:32

Introducing Sparrow-1, a conversational-flow control model built for real-time conversational video that sets the benchmark for human-level conversational timing and understanding in real-time AI.

Tavus

47,879 views • 5 months ago

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing
40:13

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing

Google AI Developers

24,239 views • 10 months ago

No more silent footage—audio-visual sync brings AI characters to life! From silent videos to Wan 2.5 Preview, which delivers frame-perfect lip-sync, multilingual dialogue, and dynamic sound effects, AI-generated video has officially left the "silent film era" behind. Now, audio and visuals emerge together from the same model—not stitched in post-production, but natively synchronized from the start. Watch the video below to uncover how AI-powered audio-visual sync is redefining content creation. #AlibabaCloud #CloudComputing #AI #AInnovation #LLM #AIVideo #WanAI #MultimodalAI
6:16

No more silent footage—audio-visual sync brings AI characters to life! From silent videos to Wan 2.5 Preview, which delivers frame-perfect lip-sync, multilingual dialogue, and dynamic sound effects, AI-generated video has officially left the "silent film era" behind. Now, audio and visuals emerge together from the same model—not stitched in post-production, but natively synchronized from the start. Watch the video below to uncover how AI-powered audio-visual sync is redefining content creation. #AlibabaCloud #CloudComputing #AI #AInnovation #LLM #AIVideo #WanAI #MultimodalAI

Alibaba Cloud

18,311 views • 4 months ago

Double the bunny host, double the muscle, double the fighting for you?! Check out last week's audio roleplay with Vanta live now! 🐰🃏
0:46

Double the bunny host, double the muscle, double the fighting for you?! Check out last week's audio roleplay with Vanta live now! 🐰🃏

Roy Chiato 🐰☕

27,514 views • 6 months ago

The AI "text to skybox" generator is now seamless! No post-processing. Check out the 360 view on the tweet below! #texttogame
1:02

The AI "text to skybox" generator is now seamless! No post-processing. Check out the 360 view on the tweet below! #texttogame

Marguerite

92,960 views • 3 years ago

Gemini 3.5 flash + Gemini managed agents api just audited a real megatron-lm ci failure inside Eigent. root cause in minutes! watch the handoff: coordinator agent plans the audit, developer agent loads the ml-failure-audit skill and gathers the evidence, then gemini agent steps in as a remote sub-agent for the heavy reasoning. gemini managed agents api and gemini 3.5 flash now live on our open-source cowork Eigent! Google AI Developers Google AI Studio
1:30

Gemini 3.5 flash + Gemini managed agents api just audited a real megatron-lm ci failure inside Eigent. root cause in minutes! watch the handoff: coordinator agent plans the audit, developer agent loads the ml-failure-audit skill and gathers the evidence, then gemini agent steps in as a remote sub-agent for the heavy reasoning. gemini managed agents api and gemini 3.5 flash now live on our open-source cowork Eigent! Google AI Developers Google AI Studio

Eigent AI

16,226 views • 27 days ago

🚨BREAKING: AI can now animate an entire cast with just audio. One track in → the lead speaks, the band plays, the dancers move. Lip sync + performance + motion all driven by sound. 5 insane examples 👀:
0:53

🚨BREAKING: AI can now animate an entire cast with just audio. One track in → the lead speaks, the band plays, the dancers move. Lip sync + performance + motion all driven by sound. 5 insane examples 👀:

Jaynit Makwana

31,998 views • 4 months ago

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.
4:01

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.

Box

489,084 views • 1 year ago

Introducing Gemini 3.5 Flash Live Translate, our real time speech to speech translation model which supports more than 70 languages (both in and out), and is so natural. It is available in the Gemini API, AI Studio, & Google Translate right now + coming soon to Google Meet!!
3:28

Introducing Gemini 3.5 Flash Live Translate, our real time speech to speech translation model which supports more than 70 languages (both in and out), and is so natural. It is available in the Gemini API, AI Studio, & Google Translate right now + coming soon to Google Meet!!

Logan Kilpatrick

446,556 views • 6 days ago

You asked for it, we delivered. The full keynote is live. In this keynote, we unveil our enhanced vision to become the World’s Ears for AI & Robotics. We are creating the world’s first decentralized infrastructure for real-world audio intelligence. Check-out our new website: Start training Voice AI now & get rewarded: From noise-level mapping to multilingual voice data and the future of live audio streams, Silencio is building the critical audio data layer that will power foundation models, embodied AI, autonomous vehicles, and robotics.
23:24

You asked for it, we delivered. The full keynote is live. In this keynote, we unveil our enhanced vision to become the World’s Ears for AI & Robotics. We are creating the world’s first decentralized infrastructure for real-world audio intelligence. Check-out our new website: Start training Voice AI now & get rewarded: From noise-level mapping to multilingual voice data and the future of live audio streams, Silencio is building the critical audio data layer that will power foundation models, embodied AI, autonomous vehicles, and robotics.

Silencio | Voice Data for AI

176,122 views • 9 months ago