Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

You can now deploy AI voice agents to LiveKit Cloud. We handle: • Stateful load balancing • Capacity management • Draining and instant rollbacks • Operational observability

LiveKit

10,045 subscribers

68,005 views • 11 months ago •via X (Twitter)

Science & Technology Arts

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

Introducing LiveKit Inference — a new cloud service that gives you access to the most popular voice AI models with just your LiveKit API key. We manage rate limits for you, report on usage, and consolidate billing. All LiveKit Cloud plans now include free monthly inference credits. A single string update allows you to call models from: AssemblyAI Deepgram Google DeepMind Inworld AI OpenAI Rime

Introducing LiveKit Inference — a new cloud service that gives you access to the most popular voice AI models with just your LiveKit API key. We manage rate limits for you, report on usage, and consolidate billing. All LiveKit Cloud plans now include free monthly inference credits. A single string update allows you to call models from: AssemblyAI Deepgram Google DeepMind Inworld AI OpenAI Rime

LiveKit

37,200 views • 10 months ago

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.

LiveKit

12,069 views • 4 months ago

Introducing Agents UI, an open-source shadcn component library for building polished React frontends for your voice agents. Audio visualizers. Media controls. Session management tools. Chat transcripts. All wired to LiveKit Agents. Install via the shadcn CLI and own the code.

Introducing Agents UI, an open-source shadcn component library for building polished React frontends for your voice agents. Audio visualizers. Media controls. Session management tools. Chat transcripts. All wired to LiveKit Agents. Install via the shadcn CLI and own the code.

LiveKit

183,036 views • 5 months ago

Add a face to your voice agent. LiveAvatar by HeyGen is now supported in LiveKit Agents. Add a realtime human avatar to your agent without rebuilding the conversation loop. Your LiveKit agent still owns the room, turn-taking, model orchestration, and voice pipeline. LiveAvatar renders the synchronized face and video stream. Useful for product demos, onboarding, tutoring, and support agents that need a visual layer.

LiveKit

10,885 views • 3 months ago

xAI STT is live. You can now run a complete cascaded voice agent pipeline on xAI (STT + Grok + TTS) through LiveKit Inference with one API key, giving you more control, full visibility, and easy component swaps.

xAI STT is live. You can now run a complete cascaded voice agent pipeline on xAI (STT + Grok + TTS) through LiveKit Inference with one API key, giving you more control, full visibility, and easy component swaps.

LiveKit

10,544 views • 3 months ago

Voice cloning is now available on LiveKit Inference. We’re launching with Inworld AI and Cartesia. Clone a voice once and use it across multiple TTS providers, with automatic fallback to the same voice if a provider fails mid-call. Free to create and available on all paid plans today.

Voice cloning is now available on LiveKit Inference. We’re launching with Inworld AI and Cartesia. Clone a voice once and use it across multiple TTS providers, with automatic fallback to the same voice if a provider fails mid-call. Free to create and available on all paid plans today.

LiveKit

11,370 views • 3 months ago

We shipped the tutorial for Agents UI. In 5 minutes you'll have a fully wired voice agent frontend with audio visualizers, media controls, and session management built directly into your codebase. Watch it, build it, own it. shadcn inside™.

We shipped the tutorial for Agents UI. In 5 minutes you'll have a fully wired voice agent frontend with audio visualizers, media controls, and session management built directly into your codebase. Watch it, build it, own it. shadcn inside™.

LiveKit

20,232 views • 5 months ago

We learn to speak before we learn to read. Voice is the most natural interface we have. We just raised a $100M to make building voice AI as easy as a web app.

We learn to speak before we learn to read. Voice is the most natural interface we have. We just raised a $100M to make building voice AI as easy as a web app.

LiveKit

232,976 views • 6 months ago

We shipped LiveKit Turn Detector v1. Instead of reading transcripts, it listens to speech directly, combining semantic and acoustic cues into one end-of-turn prediction. The result: high accuracy, low latency—the best model we tested across 14 languages. Available on LiveKit Cloud.

We shipped LiveKit Turn Detector v1. Instead of reading transcripts, it listens to speech directly, combining semantic and acoustic cues into one end-of-turn prediction. The result: high accuracy, low latency—the best model we tested across 14 languages. Available on LiveKit Cloud.

LiveKit

11,911 views • 1 month ago

How can a voice agent tell when you’re actually interrupting it? VAD is too sensitive—laughs, “mm-hmm,” or a sneeze shouldn’t stop the agent. We trained an audio model for adaptive interruption handling so agents can distinguish real interruptions from noise.

How can a voice agent tell when you’re actually interrupting it? VAD is too sensitive—laughs, “mm-hmm,” or a sneeze shouldn’t stop the agent. We trained an audio model for adaptive interruption handling so agents can distinguish real interruptions from noise.

LiveKit

43,832 views • 4 months ago

Voice agents do not sound robotic because they are slow. They sound robotic because the model writes like an essay and then reads it out loud. We just shared a post on making STT to LLM to TTS sound human. Make the model more human by including ums, sos, real pauses, and even laughter tags. Tiny rhythm changes can make a huge difference.

Voice agents do not sound robotic because they are slow. They sound robotic because the model writes like an essay and then reads it out loud. We just shared a post on making STT to LLM to TTS sound human. Make the model more human by including ums, sos, real pauses, and even laughter tags. Tiny rhythm changes can make a huge difference.

LiveKit

46,010 views • 5 months ago

We’ve raised $100M at a $1.5B valuation. We built Render to give developers an intuitive path to reliable and scalable cloud infrastructure. Now, we are bringing that same philosophy to long-running, stateful infrastructure for AI apps & agents. 🧵

We’ve raised $100M at a $1.5B valuation. We built Render to give developers an intuitive path to reliable and scalable cloud infrastructure. Now, we are bringing that same philosophy to long-running, stateful infrastructure for AI apps & agents. 🧵

Anurag Goel

518,203 views • 5 months ago

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

Today we’re launching our first homegrown AI model: an open source turn detection model for building voice agents. Instead of relying solely on voice activity detection (VAD), which only considers when a user is speaking, our model also considers what has and is being said in the context of a conversation and predicts when a user is finished expressing their thoughts before the agent responds. Conversations with AI voice agents using this new model flow much more naturally without constant interruptions from the AI— check it out (more videos, details, and code in the thread):

LiveKit

126,898 views • 1 year ago

We launched livekit-wakeword, an open-source library that lets you train a custom wake word model from scratch with a single command. It handles synthetic data generation, augmentation, training, and ONNX export all in one shot.

We launched livekit-wakeword, an open-source library that lets you train a custom wake word model from scratch with a single command. It handles synthetic data generation, augmentation, training, and ONNX export all in one shot.

LiveKit

10,104 views • 4 months ago

Claude can now create and deploy autonomous AI agents on UOMI. Connect the UOMI Skill. Describe the agent you want. Deploy it onchain. From trading agents to autonomous workflows, your AI agent can now interact with real apps, data, APIs, wallets, and markets through UOMI. Create UOMI Agents inside Claude. Skills are now live:

Claude can now create and deploy autonomous AI agents on UOMI. Connect the UOMI Skill. Describe the agent you want. Deploy it onchain. From trading agents to autonomous workflows, your AI agent can now interact with real apps, data, APIs, wallets, and markets through UOMI. Create UOMI Agents inside Claude. Skills are now live:

Uomi

14,955 views • 3 months ago

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.

What a week at #GoogleCloudNext in Las Vegas ✨ From sessions to showfloor demos to networking events, we were excited to partner with Google Cloud to advance how the AI ecosystem can build, deploy, and innovate in the cloud. Looking forward to working together to advance AI agents, physical AI, and beyond.

NVIDIA

32,762 views • 3 months ago

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →

LiveKit

159,354 views • 5 months ago

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,650 views • 1 year ago

Dart (Dart) is an AI-native project management tool built for your entire team. Brainstorm, plan, and track projects effortlessly by talking to AI. Then deploy specialized and even custom agents to handle any type of work you’ve mapped out.

Dart (Dart) is an AI-native project management tool built for your entire team. Brainstorm, plan, and track projects effortlessly by talking to AI. Then deploy specialized and even custom agents to handle any type of work you’ve mapped out.

Y Combinator

31,243 views • 10 months ago