Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Continuing with the 3D Conversational Lab, now implementing real-time lip-sync for both the user's audio & the AI agents I'm processing the Gemini Live API native audio to make the synchronization immediate Check out the flow. Inspiration explained below...

arturitu's profile picture

Arturo Paracuellos

2,436 subscribers

18,570 Aufrufe • vor 3 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Gemini 2.5 Flash Preview now supports native audio output via the Live API for seamless and natural spoken interactions. With support for 30+ voices, build conversational AI agents and experiences that feel more intuitive and natural →
0:35

Gemini 2.5 Flash Preview now supports native audio output via the Live API for seamless and natural spoken interactions. With support for 30+ voices, build conversational AI agents and experiences that feel more intuitive and natural →

Google AI Developers

23,110 Aufrufe • vor 1 Jahr

Iterating on my 3D Conversational Lab with Google AI Studio Today, I’m taking the UX a step further by mapping emotional tone to 3D animations in real-time. Using Gemini Live API function calling, the agent now detects the tone of the chat & the characters reacts accordingly.
0:29

Iterating on my 3D Conversational Lab with Google AI Studio Today, I’m taking the UX a step further by mapping emotional tone to 3D animations in real-time. Using Gemini Live API function calling, the agent now detects the tone of the chat & the characters reacts accordingly.

Arturo Paracuellos

18,511 Aufrufe • vor 3 Monaten

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.
1:23

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.

LiveKit

40,277 Aufrufe • vor 2 Monaten

Seedance 1.5 pro delivers native audio-visual synchronization with millisecond-precise lip sync. Dialogue, music, and sound effects stay aligned across multiple speakers and languages, reducing the need for post-production fixes.
0:42

Seedance 1.5 pro delivers native audio-visual synchronization with millisecond-precise lip sync. Dialogue, music, and sound effects stay aligned across multiple speakers and languages, reducing the need for post-production fixes.

BytePlus

15,459,650 Aufrufe • vor 5 Monaten

Just vibe coded with Gemini 3: an AI sparring partner to help you practice pitching skills. general chatbot is "too nice" to do that quite shocked by the low-latency audio stream by Gemini live api Google Gemini , vibe building a audio native app is no longer a dream
5:45

Just vibe coded with Gemini 3: an AI sparring partner to help you practice pitching skills. general chatbot is "too nice" to do that quite shocked by the low-latency audio stream by Gemini live api Google Gemini , vibe building a audio native app is no longer a dream

Jay Ding

12,289 Aufrufe • vor 5 Monaten

Introducing AI Voice Agents: The All-In-One Platform for Voice AI Agents and Everything Audio! 🎙 Build conversational agents, clone voices, generate sounds & engage like never before 🤖 DEMO IS LIVE: 🌱 Start farming & earn rewards!
0:54

Introducing AI Voice Agents: The All-In-One Platform for Voice AI Agents and Everything Audio! 🎙 Build conversational agents, clone voices, generate sounds & engage like never before 🤖 DEMO IS LIVE: 🌱 Start farming & earn rewards!

AI Voice Agents | AIVA

95,502 Aufrufe • vor 1 Jahr

Make some noise for React Native Audio API! 🔈 We wanted to see if we could turn a phone into a real guitar pedalboard. 🎸 Turns out, we can. 😎 Check the demo 👇
0:36

Make some noise for React Native Audio API! 🔈 We wanted to see if we could turn a phone into a real guitar pedalboard. 🎸 Turns out, we can. 😎 Check the demo 👇

Software Mansion

11,255 Aufrufe • vor 3 Monaten

React Native Audio API 0.11.0 is out! 🔊 It’s packed with tons of stability and DX improvements. We've also shipped a fully customizable recording to file and new Web Audio API nodes. Check out the demo 👇
0:22

React Native Audio API 0.11.0 is out! 🔊 It’s packed with tons of stability and DX improvements. We've also shipped a fully customizable recording to file and new Web Audio API nodes. Check out the demo 👇

Software Mansion

20,148 Aufrufe • vor 4 Monaten

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓
2:30

We unveiled the new Multimodal Live API for Gemini 2.0 Flash Experimental. ⚡ Developers can harness the power of real-time audio and video streaming to create anything from interactive assistants that respond to your voice to live translation applications. ↓

Google DeepMind

116,596 Aufrufe • vor 1 Jahr

Introducing Sparrow-1, a conversational-flow control model built for real-time conversational video that sets the benchmark for human-level conversational timing and understanding in real-time AI.
3:32

Introducing Sparrow-1, a conversational-flow control model built for real-time conversational video that sets the benchmark for human-level conversational timing and understanding in real-time AI.

Tavus

47,879 Aufrufe • vor 4 Monaten

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing
40:13

Explore the Live API’s new audio capabilities in this episode of Release Notes with Shrestha Basu Mallick and Logan Kilpatrick. From native audio output to proactive dialogue, learn how you can build more natural and engaging multimodal AI applications. Timecodes: 0:00 Intro 01:18 Live API Overview 03:36 Why audio is a special modality 05:07 Speed vs. precision in audio 06:17 Controllable and promptable TTS 08:31 What developers are building with the Live API 11:14 URL context and async calling features 15:02 Proactive audio and affective dialog 16:55 Addressing developer feedback 21:54 Live API roadmap 23:49 The role of long context 24:57 What’s next for the Live API 26:41 State of the AI audio market 30:10 Advice for developers getting started with the Live API 31:16 Live API demo 38:10 Demo wrap up and closing

Google AI Developers

24,239 Aufrufe • vor 10 Monaten

No more silent footage—audio-visual sync brings AI characters to life! From silent videos to Wan 2.5 Preview, which delivers frame-perfect lip-sync, multilingual dialogue, and dynamic sound effects, AI-generated video has officially left the "silent film era" behind. Now, audio and visuals emerge together from the same model—not stitched in post-production, but natively synchronized from the start. Watch the video below to uncover how AI-powered audio-visual sync is redefining content creation. #AlibabaCloud #CloudComputing #AI #AInnovation #LLM #AIVideo #WanAI #MultimodalAI
6:16

No more silent footage—audio-visual sync brings AI characters to life! From silent videos to Wan 2.5 Preview, which delivers frame-perfect lip-sync, multilingual dialogue, and dynamic sound effects, AI-generated video has officially left the "silent film era" behind. Now, audio and visuals emerge together from the same model—not stitched in post-production, but natively synchronized from the start. Watch the video below to uncover how AI-powered audio-visual sync is redefining content creation. #AlibabaCloud #CloudComputing #AI #AInnovation #LLM #AIVideo #WanAI #MultimodalAI

Alibaba Cloud

18,311 Aufrufe • vor 4 Monaten

Double the bunny host, double the muscle, double the fighting for you?! Check out last week's audio roleplay with Vanta live now! 🐰🃏
0:46

Double the bunny host, double the muscle, double the fighting for you?! Check out last week's audio roleplay with Vanta live now! 🐰🃏

Roy Chiato 🐰☕

27,514 Aufrufe • vor 6 Monaten

The AI "text to skybox" generator is now seamless! No post-processing. Check out the 360 view on the tweet below! #texttogame
1:02

The AI "text to skybox" generator is now seamless! No post-processing. Check out the 360 view on the tweet below! #texttogame

Marguerite

92,960 Aufrufe • vor 3 Jahren

Gemini 3.5 flash + Gemini managed agents api just audited a real megatron-lm ci failure inside Eigent. root cause in minutes! watch the handoff: coordinator agent plans the audit, developer agent loads the ml-failure-audit skill and gathers the evidence, then gemini agent steps in as a remote sub-agent for the heavy reasoning. gemini managed agents api and gemini 3.5 flash now live on our open-source cowork Eigent! Google AI Developers Google AI Studio
1:30

Gemini 3.5 flash + Gemini managed agents api just audited a real megatron-lm ci failure inside Eigent. root cause in minutes! watch the handoff: coordinator agent plans the audit, developer agent loads the ml-failure-audit skill and gathers the evidence, then gemini agent steps in as a remote sub-agent for the heavy reasoning. gemini managed agents api and gemini 3.5 flash now live on our open-source cowork Eigent! Google AI Developers Google AI Studio

Eigent AI

15,956 Aufrufe • vor 23 Tagen

🚨BREAKING: AI can now animate an entire cast with just audio. One track in → the lead speaks, the band plays, the dancers move. Lip sync + performance + motion all driven by sound. 5 insane examples 👀:
0:53

🚨BREAKING: AI can now animate an entire cast with just audio. One track in → the lead speaks, the band plays, the dancers move. Lip sync + performance + motion all driven by sound. 5 insane examples 👀:

Jaynit Makwana

31,998 Aufrufe • vor 4 Monaten

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.
4:01

See Google’s Gemini 2.5 Pro in action with the Box AI API! We put it to the test on complex invoice calculations and analyzing 10-K financial documents. Leverage Gemini 2.5 Pro via the Box AI API for advanced document processing, data extraction, and Q&A in your applications.

Box

489,084 Aufrufe • vor 1 Jahr

Introducing Gemini 3.5 Flash Live Translate, our real time speech to speech translation model which supports more than 70 languages (both in and out), and is so natural. It is available in the Gemini API, AI Studio, & Google Translate right now + coming soon to Google Meet!!
3:28

Introducing Gemini 3.5 Flash Live Translate, our real time speech to speech translation model which supports more than 70 languages (both in and out), and is so natural. It is available in the Gemini API, AI Studio, & Google Translate right now + coming soon to Google Meet!!

Logan Kilpatrick

436,382 Aufrufe • vor 3 Tagen

You asked for it, we delivered. The full keynote is live. In this keynote, we unveil our enhanced vision to become the World’s Ears for AI & Robotics. We are creating the world’s first decentralized infrastructure for real-world audio intelligence. Check-out our new website: Start training Voice AI now & get rewarded: From noise-level mapping to multilingual voice data and the future of live audio streams, Silencio is building the critical audio data layer that will power foundation models, embodied AI, autonomous vehicles, and robotics.
23:24

You asked for it, we delivered. The full keynote is live. In this keynote, we unveil our enhanced vision to become the World’s Ears for AI & Robotics. We are creating the world’s first decentralized infrastructure for real-world audio intelligence. Check-out our new website: Start training Voice AI now & get rewarded: From noise-level mapping to multilingual voice data and the future of live audio streams, Silencio is building the critical audio data layer that will power foundation models, embodied AI, autonomous vehicles, and robotics.

Silencio | Voice Data for AI

176,113 Aufrufe • vor 8 Monaten

We'd love for you to try the API or check out the Document AI playground! Both available on Mistral AI Studio.
0:59

We'd love for you to try the API or check out the Document AI playground! Both available on Mistral AI Studio.

Mistral AI

41,446 Aufrufe • vor 5 Monaten