Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

“You can build a real relationship with someone using just your voice” Understanding the power of audio, JC built Playfriends into a 1-million-user voice platform where creators can monetise through voice alone. Now, with Beam, creators can receive virtual gift without even going live. Tune in to the discussion... show more

Pukecast

62,529 subscribers

10,833 Aufrufe • vor 6 Monaten •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.

You can now create a REAL-TIME chatbot with any voice and customize its personality. Steps: 1. Go to ElevenLabs 2. Click on voices 3. you can type in a name for the voice 4. then you can drag in an audio file to use for your voice 5. then go to the agents tab in side panel 6. and create a new agent 7. the voice 8. Create system instructions 9. Optional (Upload knowledge docs) 10. Test This can be easily implemented into your applications. I'll make a tutorial on that soon.

Riley Brown

40,108 Aufrufe • vor 1 Jahr

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.

With Gemini 3 Flash, you can quickly build fun, useful apps from scratch using your voice without any prior coding knowledge. Just dictate to Gemini on the go, and it can transform your unstructured thoughts into a functioning app in minutes.

Google Gemini

2,481,254 Aufrufe • vor 7 Monaten

Voice used to be AI’s forgotten modality - now it's having its big moment: rapid innovation, big funding rounds, major agentic applications My conversation with Neil Zeghidour, top AI researcher in the field (Google DeepMind, Meta, kyutai) and now CEO of Gradium This is a reference episode on all things voice AI 🔥 00:00 Intro 01:21 Voice AI’s big moment, and why we’re still early 03:34 Why voice lagged behind text/image/video 06:06 The convergence era: transformers for every modality 07:40 Beyond Her: always-on assistants, wake words, voice-first devices 11:01 Voice vs text: where voice fits (even for coding) 12:56 Neil’s origin story: from finance to machine learning, with help from Yann LeCun and Soumith Chintala 18:35 Neural codecs (SoundStream): compression as the unlock 22:30 Kyutai: open research, small elite teams, moving fast 31:32 Why big labs haven’t “won” voice AI4 34:01 On-device voice: where it works, why compact models matter 46:37 The last mile: real-world robustness, pronunciation, uptime 41:35 Benchmarking voice: why metrics fail, how they actually test 47:03 Cascades vs speech-to-speech: trade-offs + what’s next 54:05 Hardest frontier: noisy rooms, factories, multi-speaker chaos 1:00:50 New languages + dialects: what transfers, what doesn’t 1:02:54 Hardware & compute: why voice isn’t a 10,000-GPU game 1:07:27 What data do you need to train voice models 1:09:02 Deepfakes + privacy: why watermarking isn’t a solution 1:12:30 Voice + vision: multimodality, screen awareness, video+audio 1:14:43 Voice cloning vs voice design: where the market goes 1:16:32 Paris/Europe AI: talent density, underdog energy, what’s next

Voice used to be AI’s forgotten modality - now it's having its big moment: rapid innovation, big funding rounds, major agentic applications My conversation with Neil Zeghidour, top AI researcher in the field (Google DeepMind, Meta, kyutai) and now CEO of Gradium This is a reference episode on all things voice AI 🔥 00:00 Intro 01:21 Voice AI’s big moment, and why we’re still early 03:34 Why voice lagged behind text/image/video 06:06 The convergence era: transformers for every modality 07:40 Beyond Her: always-on assistants, wake words, voice-first devices 11:01 Voice vs text: where voice fits (even for coding) 12:56 Neil’s origin story: from finance to machine learning, with help from Yann LeCun and Soumith Chintala 18:35 Neural codecs (SoundStream): compression as the unlock 22:30 Kyutai: open research, small elite teams, moving fast 31:32 Why big labs haven’t “won” voice AI4 34:01 On-device voice: where it works, why compact models matter 46:37 The last mile: real-world robustness, pronunciation, uptime 41:35 Benchmarking voice: why metrics fail, how they actually test 47:03 Cascades vs speech-to-speech: trade-offs + what’s next 54:05 Hardest frontier: noisy rooms, factories, multi-speaker chaos 1:00:50 New languages + dialects: what transfers, what doesn’t 1:02:54 Hardware & compute: why voice isn’t a 10,000-GPU game 1:07:27 What data do you need to train voice models 1:09:02 Deepfakes + privacy: why watermarking isn’t a solution 1:12:30 Voice + vision: multimodality, screen awareness, video+audio 1:14:43 Voice cloning vs voice design: where the market goes 1:16:32 Paris/Europe AI: talent density, underdog energy, what’s next

Matt Turck

22,949 Aufrufe • vor 5 Monaten

When beauty meets brains, you get Een. At YGG Play Summit, Een shared how her strict upbringing shaped her journey from creator and cosplayer into the founder of three passion-led businesses. Tune in👇🏻 02:05 - How Een got into gaming 05:55 - Een’s strategy for staying relevant as a content creator 08:33 - Een's journey into web3.

When beauty meets brains, you get Een. At YGG Play Summit, Een shared how her strict upbringing shaped her journey from creator and cosplayer into the founder of three passion-led businesses. Tune in👇🏻 02:05 - How Een got into gaming 05:55 - Een’s strategy for staying relevant as a content creator 08:33 - Een's journey into web3.

Pukecast

20,566 Aufrufe • vor 6 Monaten

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:

Andrew Ng

87,140 Aufrufe • vor 1 Monat

Over the past 6 weeks, I've automated dozens of hours of grunt, repetitive work. Every Friday, I spend a few minutes writing down everything I do more than once during the week: 1. I automate what I can automate 2. I improve what I can't automate Two levels of unlock here: 1. Start using voice 2. Start using voice-to-action agents The team reached out to partner with me. I've been testing them, and this is precisely what they do. First, if you are still typing your prompts, stop. Start using voice. Go from typing to dictation on your computer. This alone will save you hours every year. Second, move from asking questions to using an agent that automates tasks for you. Lemon is a VOICE-TO-ACTION agent (instead of a voice-to-text model): • You press a button • You say what you need • Lemon executes the task in whatever app you are using Lemon works across Mac apps, so you can drive them all with your voice. Lemon is currently free. 100% worth trying.

Over the past 6 weeks, I've automated dozens of hours of grunt, repetitive work. Every Friday, I spend a few minutes writing down everything I do more than once during the week: 1. I automate what I can automate 2. I improve what I can't automate Two levels of unlock here: 1. Start using voice 2. Start using voice-to-action agents The team reached out to partner with me. I've been testing them, and this is precisely what they do. First, if you are still typing your prompts, stop. Start using voice. Go from typing to dictation on your computer. This alone will save you hours every year. Second, move from asking questions to using an agent that automates tasks for you. Lemon is a VOICE-TO-ACTION agent (instead of a voice-to-text model): • You press a button • You say what you need • Lemon executes the task in whatever app you are using Lemon works across Mac apps, so you can drive them all with your voice. Lemon is currently free. 100% worth trying.

Santiago

20,566 Aufrufe • vor 5 Monaten

Content is already saturated, but AI is making it infinite. Now the biggest threat to creators is becoming invisible and getting lost in the wave of videos posted everyday. Today we dive into how you can defend yourself against it, break-through, and create something meaningful. 00:00 The Age of AI Slop and Abundance 02:43 The Problem with Content Saturation 06:10 Case Studies: From VTubers to Digital Twins 17:04 AI Replicas in Long Form and Hollywood 25:55 The Two Paths for Creators Now: Scale & Scarcity 36:02 IRL Value and the "Offline" Movement 40:20 Finding Your Voice in a Hostile Feed

Content is already saturated, but AI is making it infinite. Now the biggest threat to creators is becoming invisible and getting lost in the wave of videos posted everyday. Today we dive into how you can defend yourself against it, break-through, and create something meaningful. 00:00 The Age of AI Slop and Abundance 02:43 The Problem with Content Saturation 06:10 Case Studies: From VTubers to Digital Twins 17:04 AI Replicas in Long Form and Hollywood 25:55 The Two Paths for Creators Now: Scale & Scarcity 36:02 IRL Value and the "Offline" Movement 40:20 Finding Your Voice in a Hostile Feed

Colin and Samir ✌🏼✌🏾

13,170 Aufrufe • vor 5 Monaten

We're launching the ElevenLabs Impact Program to help 1 million people reclaim their voice. We’re partnering with nonprofits to provide free licenses to enhance accessibility, advance education, and improve shared cultural experiences. Our first initiative, made possible through partnership with Bridging Voice and The Scott-Morgan Foundation, is aimed at helping everyone with ALS / MND preserve their voice through free access to our technology to create personalized digital voices that closely match their natural speech. If this can benefit you or a loved one, learn more here: If your nonprofit can benefit from AI Audio, get in touch:

We're launching the ElevenLabs Impact Program to help 1 million people reclaim their voice. We’re partnering with nonprofits to provide free licenses to enhance accessibility, advance education, and improve shared cultural experiences. Our first initiative, made possible through partnership with Bridging Voice and The Scott-Morgan Foundation, is aimed at helping everyone with ALS / MND preserve their voice through free access to our technology to create personalized digital voices that closely match their natural speech. If this can benefit you or a loved one, learn more here: If your nonprofit can benefit from AI Audio, get in touch:

ElevenLabs

109,635 Aufrufe • vor 1 Jahr

Day 1 in Manila and the pre-party for YGG Play Summit was already all warmed up. Everyone here can SING, even Ross.pengu ?! And we’re just getting started, day 2 & 3 dropping soon, stay tuned 👇🏻

Day 1 in Manila and the pre-party for YGG Play Summit was already all warmed up. Everyone here can SING, even Ross.pengu ?! And we’re just getting started, day 2 & 3 dropping soon, stay tuned 👇🏻

Pukecast

11,216 Aufrufe • vor 8 Monaten

This went viral, so I built an enhanced version: A video recorder where the AI talks back at you to give you live inspiration, via either voice or text on screen. And it can magically remove the silent parts of the video with 1 click, so you can download a clean video. I was SHOCKED when this video editing feature just worked in Google AI Studio.

This went viral, so I built an enhanced version: A video recorder where the AI talks back at you to give you live inspiration, via either voice or text on screen. And it can magically remove the silent parts of the video with 1 click, so you can download a clean video. I was SHOCKED when this video editing feature just worked in Google AI Studio.

Zara Zhang

86,365 Aufrufe • vor 7 Monaten

Vibe Coding: The act of using only your voice in Cursor Composer to build apps, forgetting the code even exists Complete Video Tutorial Some people are skeptical about this new method of programming so why don't we build a ChatGPT clone with real time voice ( Andrej Karpathy 's voice) without typing, using Whispr Flow. For me "vibe coding" is my only option. Because i've never written a line of code. Time Stamps: 00:00 Intro to Vibe Coding (pretty corny) 03:02 Opening Cursor 04:07 Starting Your First Project from Template Link (Pinned to bio of @senior_swc ) 05:12 Building a ChatGPT Clone, Getting Started 06:38 Prompting, API's and Documentation Explanation 08:49 Using Perplexity (Input output custom spaces for coding) 12:07 Vibe Code Prompt 1 13:58 Result of Vibe Coding Prompt 1 15:22 Seeing Prompt 2 15:43 Managing Cursor Composer Context Length 16:25 Designing 17:21 Debugging with Inspect on Web View 18:20 Fixing Formatting 19:04 More Vibing, Lol 20:51 Saving and Uploading Projects to GitHub 21:59 Enhancing the User Experience 22:33 Honoring Andrej Karpathy 26:26 Implementing Real Time Karpathy Voice 28:30 Getting Karpathys Voice (Don't Do this It's Illegal) don't ban me i love you

Vibe Coding: The act of using only your voice in Cursor Composer to build apps, forgetting the code even exists Complete Video Tutorial Some people are skeptical about this new method of programming so why don't we build a ChatGPT clone with real time voice ( Andrej Karpathy 's voice) without typing, using Whispr Flow. For me "vibe coding" is my only option. Because i've never written a line of code. Time Stamps: 00:00 Intro to Vibe Coding (pretty corny) 03:02 Opening Cursor 04:07 Starting Your First Project from Template Link (Pinned to bio of @senior_swc ) 05:12 Building a ChatGPT Clone, Getting Started 06:38 Prompting, API's and Documentation Explanation 08:49 Using Perplexity (Input output custom spaces for coding) 12:07 Vibe Code Prompt 1 13:58 Result of Vibe Coding Prompt 1 15:22 Seeing Prompt 2 15:43 Managing Cursor Composer Context Length 16:25 Designing 17:21 Debugging with Inspect on Web View 18:20 Fixing Formatting 19:04 More Vibing, Lol 20:51 Saving and Uploading Projects to GitHub 21:59 Enhancing the User Experience 22:33 Honoring Andrej Karpathy 26:26 Implementing Real Time Karpathy Voice 28:30 Getting Karpathys Voice (Don't Do this It's Illegal) don't ban me i love you

Riley Brown

73,901 Aufrufe • vor 1 Jahr

1. A paralyzed man is now able to "speak" in his own voice, thanks to Elon's Neuralink brain chip. Bradford Smith, who has ALS—a disease that left only his brain and eyes working—got a Neuralink implant in January. Now, he can talk with his family more normally. He types using just his thoughts on a virtual keyboard. Then Grok AI helps complete his sentences and turns the text into speech that sounds like his real voice, recreated from old audio clips. Bradford shared his experience and a look at the interface on Twitter, expressing how happy he is with the result.

1. A paralyzed man is now able to "speak" in his own voice, thanks to Elon's Neuralink brain chip. Bradford Smith, who has ALS—a disease that left only his brain and eyes working—got a Neuralink implant in January. Now, he can talk with his family more normally. He types using just his thoughts on a virtual keyboard. Then Grok AI helps complete his sentences and turns the text into speech that sounds like his real voice, recreated from old audio clips. Bradford shared his experience and a look at the interface on Twitter, expressing how happy he is with the result.

Mario Nawfal

72,932 Aufrufe • vor 1 Jahr

Start going much deeper and much more nuanced in your “prompts” with your 🤖 apps - too many still use ChatGPT like it’s Google search.. when it has much more power than that and can give you much more in depth answers and more importantly can be a working partner versus a quick tool .. hope this inspires more to use their voice - I think voice will be the main interface with ai 🤖 in the next decade & I hope this inspires someone to ask much more detailed questions and go much deeper with their details and nuances! What’s the longest prompt you’ve made so far ? What are u using these apps for so far?

Start going much deeper and much more nuanced in your “prompts” with your 🤖 apps - too many still use ChatGPT like it’s Google search.. when it has much more power than that and can give you much more in depth answers and more importantly can be a working partner versus a quick tool .. hope this inspires more to use their voice - I think voice will be the main interface with ai 🤖 in the next decade & I hope this inspires someone to ask much more detailed questions and go much deeper with their details and nuances! What’s the longest prompt you’ve made so far ? What are u using these apps for so far?

Gary Vaynerchuk

65,111 Aufrufe • vor 9 Monaten

This is your reminder to play The Dream, 404’s Chroma Award-winning game built using SN17-generated assets. At 404, we aim to help kickstart the next revolution in gaming around AI-native games. That starts with democratising 3D content creation through Bittensor, making it easier for creators to build virtual worlds, games, and AR/VR/XR experiences without needing massive production teams. The long-term vision is to let creators describe the game or world they want to build, then generate the assets, sound, voice, and environment around it. The Dream is an amazing example of that vision. It is a fully playable 3D open-world experience created by a two-person team in just 30 days, using over 12,000 assets generated with 404. The goal is not to replace enterprise game development. It is to create a new layer where individuals and small teams can build and explore high-fidelity game worlds without needing a massive AAA-style pipeline. Sometimes, you need to see it to believe it. Play The Dream yourself at:

This is your reminder to play The Dream, 404’s Chroma Award-winning game built using SN17-generated assets. At 404, we aim to help kickstart the next revolution in gaming around AI-native games. That starts with democratising 3D content creation through Bittensor, making it easier for creators to build virtual worlds, games, and AR/VR/XR experiences without needing massive production teams. The long-term vision is to let creators describe the game or world they want to build, then generate the assets, sound, voice, and environment around it. The Dream is an amazing example of that vision. It is a fully playable 3D open-world experience created by a two-person team in just 30 days, using over 12,000 assets generated with 404. The goal is not to replace enterprise game development. It is to create a new layer where individuals and small teams can build and explore high-fidelity game worlds without needing a massive AAA-style pipeline. Sometimes, you need to see it to believe it. Play The Dream yourself at:

404

18,936 Aufrufe • vor 13 Tagen

Snipverse 3.0 is more than just an update... it's the foundation for the next chapter of the platform. Over the past few years, we've rebuilt Snipverse from the ground up with a modern, scalable infrastructure, a faster user experience, live streaming, Voice Lounges, multi-channel chat, and powerful new tools for creators. We're also taking a major step toward community ownership. Governance will give SNIPS holders a voice in the future of Snipverse through proposals, voting, and decisions that help shape the platform as it continues to grow. Looking back at how far we've come makes us even more excited for what's ahead. Thank you to everyone who has supported, tested, and believed in our vision. Snipverse 3.0 is almost here. #Snipverse #XPRNetwork $SNIPS $XPR

Snipverse 3.0 is more than just an update... it's the foundation for the next chapter of the platform. Over the past few years, we've rebuilt Snipverse from the ground up with a modern, scalable infrastructure, a faster user experience, live streaming, Voice Lounges, multi-channel chat, and powerful new tools for creators. We're also taking a major step toward community ownership. Governance will give SNIPS holders a voice in the future of Snipverse through proposals, voting, and decisions that help shape the platform as it continues to grow. Looking back at how far we've come makes us even more excited for what's ahead. Thank you to everyone who has supported, tested, and believed in our vision. Snipverse 3.0 is almost here. #Snipverse #XPRNetwork $SNIPS $XPR

Snipverse.com

16,947 Aufrufe • vor 22 Tagen

"Voice agents are built to be helpful. The problem is they can be too helpful and cross the boundary." I sat down with Sumanyu Sharma 🍫, Founder and CEO of Hamming, at our AI Engineer booth. Hamming stress-tests and monitors voice agents so the bank or hospital running one catches failures before a customer does. Fresh after his talk “I Monitored Crime Audio. Voice Agents Scare Me More,” we got into: 0:00 how Sumanyu went from listening to 911 calls at Citizen to founding Hamming AI 0:39 why he's more nervous about voice agents than he was about crime 1:51 the first voice-agent security product 3:16 simulating messy reality: accents, background noise, code-switching 4:11 voice agents testing voice agents 5:47 why taking actions is table stakes, and what makes it dangerous 11:07 hot take: everyone rushed to B2B, more founders should build consumer Thanks for coming to our Browserbase booth, Sumanyu Sharma 🍫! Watch the full episode here:

"Voice agents are built to be helpful. The problem is they can be too helpful and cross the boundary." I sat down with Sumanyu Sharma 🍫, Founder and CEO of Hamming, at our AI Engineer booth. Hamming stress-tests and monitors voice agents so the bank or hospital running one catches failures before a customer does. Fresh after his talk “I Monitored Crime Audio. Voice Agents Scare Me More,” we got into: 0:00 how Sumanyu went from listening to 911 calls at Citizen to founding Hamming AI 0:39 why he's more nervous about voice agents than he was about crime 1:51 the first voice-agent security product 3:16 simulating messy reality: accents, background noise, code-switching 4:11 voice agents testing voice agents 5:47 why taking actions is table stakes, and what makes it dangerous 11:07 hot take: everyone rushed to B2B, more founders should build consumer Thanks for coming to our Browserbase booth, Sumanyu Sharma 🍫! Watch the full episode here:

justine

18,048 Aufrufe • vor 10 Tagen

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Day 1 of 3 days of MLX: Introducing MLX-Audio-Swift SDK 🚀 A modular Swift SDK for voice agents and tasks on Apple Silicon built by Lucas Newman and yours truly. iOS, macOS, and visionOS developers can now build native apps with real-time, on-device audio intelligence: 🗣️ Text-to-Speech (TTS) 👂 Speech-to-Text (STT) 🔄 Speech-to-Speech (STS) 🎙️ Voice Activity Detection (VAD) and more. Only import the capabilities you need, nothing extra. Get started today and leave us a star ⭐️

Prince Canuma

163,744 Aufrufe • vor 5 Monaten

the real UGC industry isn't dying, it already died created this AI UGC in just a few minutes using my brand new system, from first prompt to final video > product stays in frame exactly where it should > few different people in same one video > can be adapted to any script, character, and environment > voice sounds like a real person, not a robot reading a script > movements are smooth and controlable in every shot > no time limit - make it as long as you need with this level of AI UGC, you can create and test 50x more ads than with real creators while saving $300-$500+ per video

MAX

18,229 Aufrufe • vor 3 Monaten

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,628 Aufrufe • vor 1 Jahr