Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Learn how to build an audiobook voice agent using Gradium and Pipecat AI Gradium's TTS handles the narration and Pipecat's built-in WebRTC transport delivers the audio to the browser.

GradiumAI's profile picture

Gradium

3,933 subscribers

11,247 Aufrufe • vor 2 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Build a conversational voice bot with 1 second voice-to-voice latency with Modal, Pipecat AI, and open models. Modal works seamlessly with WebRTC, WebSockets, and tunneling to squash latency to an absolute minimum.
1:01

Build a conversational voice bot with 1 second voice-to-voice latency with Modal, Pipecat AI, and open models. Modal works seamlessly with WebRTC, WebSockets, and tunneling to squash latency to an absolute minimum.

Modal

29,559 Aufrufe • vor 9 Monaten

Give your voice agents a face with Decart • ElevenLabs generates speech stream • Decart animates the video avatar in realtime with lip sync • Pipecat orchestrates the pipeline and handles WebRTC transport Open-source demo code below.
4:10

Give your voice agents a face with Decart • ElevenLabs generates speech stream • Decart animates the video avatar in realtime with lip sync • Pipecat orchestrates the pipeline and handles WebRTC transport Open-source demo code below.

ElevenLabs Developers

29,269 Aufrufe • vor 10 Monaten

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:
2:41

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,711 Aufrufe • vor 1 Jahr

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.
4:18

How to build the world's fastest voice AI bot: - Self-host speech-to-text, LLM inference, and text-to-speech all together in the same container/cluster. - Route audio over the internet using WebRTC and edge networking. - Configure timings for voice activity detection, phrase endpointing, and other parts of the pipeline to optimize for latency. (There are trade-offs to doing this!) Here's a LLama 3 voice bot that has voice-to-voice response times of ~500ms. We used Deepgram's STT and TTS for this bot, and everything is hosted on cerebriumai's serverless GPU infrastructure.

kwindla

282,617 Aufrufe • vor 2 Jahren

Build a real-time AI Voice Agent that can actually sell. In less than 30 minutes, you'll learn how to build a sophisticated real-time voice sales agent that can have natural conversations with potential customers. Includes a full code notebook, recorded tutorial, and docs The stack: ⚡ fast inference 🎙 LiveKit for real-time audio/video infrastructure 🗣 realistic speech synthesis (STT/TTS)
0:30

Build a real-time AI Voice Agent that can actually sell. In less than 30 minutes, you'll learn how to build a sophisticated real-time voice sales agent that can have natural conversations with potential customers. Includes a full code notebook, recorded tutorial, and docs The stack: ⚡ fast inference 🎙 LiveKit for real-time audio/video infrastructure 🗣 realistic speech synthesis (STT/TTS)

Sarah Chieng

452,438 Aufrufe • vor 11 Monaten

Antigravity’s browser sub-agent can "look" at your app, scroll through it, and click to verify that everything works before you deploy. It’s built-in safety using screenshots and recordings. See the browser agent verify a live build →
1:14

Antigravity’s browser sub-agent can "look" at your app, scroll through it, and click to verify that everything works before you deploy. It’s built-in safety using screenshots and recordings. See the browser agent verify a live build →

Google Cloud Tech

28,277 Aufrufe • vor 5 Monaten

Learn how to build a real-time voice AI agent using Gemini Live. In this demo created by Software Mansion, users solve a mystery in this interactive game featuring an AI narrator.
0:55

Learn how to build a real-time voice AI agent using Gemini Live. In this demo created by Software Mansion, users solve a mystery in this interactive game featuring an AI narrator.

Google AI Developers

10,333 Aufrufe • vor 6 Monaten

Learn how to build an AI agent in 175 lines of Python.
5:11

Learn how to build an AI agent in 175 lines of Python.

Lee Robinson

72,218 Aufrufe • vor 1 Jahr

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI
1:48

Llama 4 voice agent starter kit with Groq Inc and Pipecat AI ➡️ Groq STT (distil-whisper-large-v3) ➡️ Groq Llama 4 (llama-4-scout-17b-16e-instruct) ➡️ Groq TTS (playai-tts) ➡️ Function calling ➡️ Deploy to Pipecat Cloud for production ➡️ Optionally add a twilio phone number for telephone voice AI

kwindla

58,764 Aufrufe • vor 1 Jahr

Your AI agent can create an entire Google Form for you by chatting, and it will use the browser to type and build the survey automatically.
0:29

Your AI agent can create an entire Google Form for you by chatting, and it will use the browser to type and build the survey automatically.

Kimi.ai

16,743 Aufrufe • vor 3 Monaten

Great products are built on great standards. Just like Netscape’s browser transformed the web, the Think Agent Standard will transform how AI agents build, connect, and evolve in the open metaverse. 🧵
2:40

Great products are built on great standards. Just like Netscape’s browser transformed the web, the Think Agent Standard will transform how AI agents build, connect, and evolve in the open metaverse. 🧵

THINK

181,861 Aufrufe • vor 1 Jahr

Learn how to build AI web apps as a frontend developer! In this video, I explain how I built and give you the starter code to build your own AI apps:
4:19

Learn how to build AI web apps as a frontend developer! In this video, I explain how I built and give you the starter code to build your own AI apps:

Hassan

315,523 Aufrufe • vor 3 Jahren

Using the Hermes Agent and Venice API to build my AI clone
13:32

Using the Hermes Agent and Venice API to build my AI clone

Sabrina

133,459 Aufrufe • vor 3 Monaten

Open AI released Operator, an agent that can use the browser to perform and automate tasks for you! I have built an Open Source version of Operator using Browser Use, running locally on your computer. 100% Open Source
0:59

Open AI released Operator, an agent that can use the browser to perform and automate tasks for you! I have built an Open Source version of Operator using Browser Use, running locally on your computer. 100% Open Source

Sumanth

62,485 Aufrufe • vor 1 Jahr

AI can really do anything... someone asked me how to build an AI Agent that books meetings with a calendar link. I built this in 2 minutes with Cursor and npx create-browser-app 👇
0:55

AI can really do anything... someone asked me how to build an AI Agent that books meetings with a calendar link. I built this in 2 minutes with Cursor and npx create-browser-app 👇

Paul Klein IV

51,997 Aufrufe • vor 1 Jahr

"Free, accurate voice transcription in the browser using Whisper" ⚡️ I'm happy to share a modern voice-to-text app (Say) that uses in-browser AI (Whisper and T5) to offer voice transcription, text summaries and note management. Everything is done locally in a privacy-friendly way. Built with React and Transformers.js by Xenova
1:27

"Free, accurate voice transcription in the browser using Whisper" ⚡️ I'm happy to share a modern voice-to-text app (Say) that uses in-browser AI (Whisper and T5) to offer voice transcription, text summaries and note management. Everything is done locally in a privacy-friendly way. Built with React and Transformers.js by Xenova

Addy Osmani

36,822 Aufrufe • vor 1 Jahr

We're winning the AI browser wars, and we're not even trying. Our mission isn't to build a browser. We're an agent company, not a browser company. We've seen firsthand how teams struggle to get started with AI. The tools they tried are too complex and lack the context you need. We decided to build a browser since it's already the tool you work in. We all know how to use a browser. You can pick up Strawberry and start using AI agents from day one. By building a browser we are also positioning ourselves to build towards the internet of the future. An internet where trillions of agents will be communicating with each other. This is the biggest opportunity of our lifetime. But someone has to make sure it is safe, effective and accessible to teams across the world. That is our mission.
0:52

We're winning the AI browser wars, and we're not even trying. Our mission isn't to build a browser. We're an agent company, not a browser company. We've seen firsthand how teams struggle to get started with AI. The tools they tried are too complex and lack the context you need. We decided to build a browser since it's already the tool you work in. We all know how to use a browser. You can pick up Strawberry and start using AI agents from day one. By building a browser we are also positioning ourselves to build towards the internet of the future. An internet where trillions of agents will be communicating with each other. This is the biggest opportunity of our lifetime. But someone has to make sure it is safe, effective and accessible to teams across the world. That is our mission.

Charles Maddock

42,142 Aufrufe • vor 2 Monaten