Загрузка видео...

Не удалось загрузить видео

На главную

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.

livekit's profile picture

LiveKit

10,949 subscribers

12,124 просмотров • 5 месяцев назад •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 10

Фото профиля Jack
Jack5 месяцев назад

Will never debug any other way again

Фото профиля Mahimai Raja J ‎
Mahimai Raja J ‎5 месяцев назад

This is quiet insane and helpful for every voice debugging

Фото профиля JpK
JpK5 месяцев назад

We had left LiveKit because of the slow time to get logs, hopefully it will be much better

Фото профиля Aria
Aria5 месяцев назад

This is huge. We're using LiveKit Cloud for Aria! Live audio rooms where domain expert AI voice agents speak alongside real people in 13 languages! Debugging the voice pipeline in real-time is exactly what we needed! Trying this today.

Фото профиля Max Petrusenko
Max Petrusenko5 месяцев назад

Realtime console is useful—how do you capture and replay exact audio plus agent state so nondeterministic failures reproduce reliably?

Фото профиля Max Petrusenko
Max Petrusenko5 месяцев назад

If you support replaying deterministic state and tool calls like Agent Persona does you can triage voice regressions far faster and validate fixes locally.

Фото профиля LiveKit
LiveKit5 месяцев назад

Read more in our blog:

Фото профиля Gregor
Gregor5 месяцев назад

Debugging voice agents without seeing the pipeline in real time is like trying to fix a car with the hood welded shut. This changes everything for anyone building conversational AI.

Фото профиля Max Petrusenko
Max Petrusenko5 месяцев назад

Latency metrics are noise unless paired with automated fault triggers; what checkpoints or alerts tie latency spikes to specific tool calls or transcripts?

Фото профиля ZAZA
ZAZA5 месяцев назад

Awesome job guys

Похожие видео

Add a face to your voice agent. LiveAvatar by HeyGen is now supported in LiveKit Agents. Add a realtime human avatar to your agent without rebuilding the conversation loop. Your LiveKit agent still owns the room, turn-taking, model orchestration, and voice pipeline. LiveAvatar renders the synchronized face and video stream. Useful for product demos, onboarding, tutoring, and support agents that need a visual layer.
5:14

Add a face to your voice agent. LiveAvatar by HeyGen is now supported in LiveKit Agents. Add a realtime human avatar to your agent without rebuilding the conversation loop. Your LiveKit agent still owns the room, turn-taking, model orchestration, and voice pipeline. LiveAvatar renders the synchronized face and video stream. Useful for product demos, onboarding, tutoring, and support agents that need a visual layer.

LiveKit

10,885 просмотров • 4 месяцев назад

We shipped LiveKit Turn Detector v1. Instead of reading transcripts, it listens to speech directly, combining semantic and acoustic cues into one end-of-turn prediction. The result: high accuracy, low latency—the best model we tested across 14 languages. Available on LiveKit Cloud.
5:08

We shipped LiveKit Turn Detector v1. Instead of reading transcripts, it listens to speech directly, combining semantic and acoustic cues into one end-of-turn prediction. The result: high accuracy, low latency—the best model we tested across 14 languages. Available on LiveKit Cloud.

LiveKit

12,053 просмотров • 3 месяцев назад

We shipped the tutorial for Agents UI. In 5 minutes you'll have a fully wired voice agent frontend with audio visualizers, media controls, and session management built directly into your codebase. Watch it, build it, own it. shadcn inside™.
11:49

We shipped the tutorial for Agents UI. In 5 minutes you'll have a fully wired voice agent frontend with audio visualizers, media controls, and session management built directly into your codebase. Watch it, build it, own it. shadcn inside™.

LiveKit

20,232 просмотров • 6 месяцев назад

Introducing Agents UI, an open-source shadcn component library for building polished React frontends for your voice agents. Audio visualizers. Media controls. Session management tools. Chat transcripts. All wired to LiveKit Agents. Install via the shadcn CLI and own the code.
0:43

Introducing Agents UI, an open-source shadcn component library for building polished React frontends for your voice agents. Audio visualizers. Media controls. Session management tools. Chat transcripts. All wired to LiveKit Agents. Install via the shadcn CLI and own the code.

LiveKit

183,678 просмотров • 6 месяцев назад

GPT-Live-1 OpenAI Developers is now supported in LiveKit Agents. It's full-duplex, so it listens and speaks at the same time instead of taking turns, and it hands reasoning and tool calls off to a backend model so a slow lookup doesn't leave your agent sitting in dead air. Same `AgentSession` API. New plugin: `GPTLiveModel`. Get started:
3:56

GPT-Live-1 OpenAI Developers is now supported in LiveKit Agents. It's full-duplex, so it listens and speaks at the same time instead of taking turns, and it hands reasoning and tool calls off to a backend model so a slow lookup doesn't leave your agent sitting in dead air. Same `AgentSession` API. New plugin: `GPTLiveModel`. Get started:

LiveKit

67,092 просмотров • 7 дней назад

Build voice agents that can respond quickly or think longer without changing your stack. Gemini 3.8 Live is available today in LiveKit Agents. Choose gemini-3.8-live for low-latency audio or gemini-3.8-live-extended-thinking for async reasoning. Check the docs for more info:
5:00

Build voice agents that can respond quickly or think longer without changing your stack. Gemini 3.8 Live is available today in LiveKit Agents. Choose gemini-3.8-live for low-latency audio or gemini-3.8-live-extended-thinking for async reasoning. Check the docs for more info:

LiveKit

17,033 просмотров • 2 дней назад

You can now deploy AI voice agents to LiveKit Cloud. We handle: • Stateful load balancing • Capacity management • Draining and instant rollbacks • Operational observability
0:55

You can now deploy AI voice agents to LiveKit Cloud. We handle: • Stateful load balancing • Capacity management • Draining and instant rollbacks • Operational observability

LiveKit

68,082 просмотров • 1 год назад

Protect sensitive data without giving up voice agent observability. LiveKit PII Redaction automatically removes personal information from transcripts and recordings before it is stored. It is included with LiveKit Agent Observability at no additional cost. Read more:
3:34

Protect sensitive data without giving up voice agent observability. LiveKit PII Redaction automatically removes personal information from transcripts and recordings before it is stored. It is included with LiveKit Agent Observability at no additional cost. Read more:

LiveKit

73,111 просмотров • 28 дней назад

Today we're launching Expressive mode in LiveKit Agents. Most voice agents deliver every sentence in that same, upbeat register we all know and hate (including bad news). Expressive mode makes your agent sound like it registers what the caller is actually feeling.
3:29

Today we're launching Expressive mode in LiveKit Agents. Most voice agents deliver every sentence in that same, upbeat register we all know and hate (including bad news). Expressive mode makes your agent sound like it registers what the caller is actually feeling.

LiveKit

378,230 просмотров • 1 месяц назад

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:
2:41

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,810 просмотров • 1 год назад

How can a voice agent tell when you’re actually interrupting it? VAD is too sensitive—laughs, “mm-hmm,” or a sneeze shouldn’t stop the agent. We trained an audio model for adaptive interruption handling so agents can distinguish real interruptions from noise.
2:34

How can a voice agent tell when you’re actually interrupting it? VAD is too sensitive—laughs, “mm-hmm,” or a sneeze shouldn’t stop the agent. We trained an audio model for adaptive interruption handling so agents can distinguish real interruptions from noise.

LiveKit

44,054 просмотров • 6 месяцев назад

xAI STT is live. You can now run a complete cascaded voice agent pipeline on xAI (STT + Grok + TTS) through LiveKit Inference with one API key, giving you more control, full visibility, and easy component swaps.
5:03

xAI STT is live. You can now run a complete cascaded voice agent pipeline on xAI (STT + Grok + TTS) through LiveKit Inference with one API key, giving you more control, full visibility, and easy component swaps.

LiveKit

10,544 просмотров • 5 месяцев назад

Watch me build + deploy a voice agent to the free tier of LiveKit Cloud in <2 mins. Latency is amazing, process is dead simple, and it's all your own code so your agent can do legit anything. This is the most flexible, performant, and EASY way to develop apps for voice.
1:57

Watch me build + deploy a voice agent to the free tier of LiveKit Cloud in <2 mins. Latency is amazing, process is dead simple, and it's all your own code so your agent can do legit anything. This is the most flexible, performant, and EASY way to develop apps for voice.

Shayne

11,335 просмотров • 1 год назад

Introducing LiveKit Inference — a new cloud service that gives you access to the most popular voice AI models with just your LiveKit API key. We manage rate limits for you, report on usage, and consolidate billing. All LiveKit Cloud plans now include free monthly inference credits. A single string update allows you to call models from: AssemblyAI Deepgram Google DeepMind OpenAI Rime
3:21

Introducing LiveKit Inference — a new cloud service that gives you access to the most popular voice AI models with just your LiveKit API key. We manage rate limits for you, report on usage, and consolidate billing. All LiveKit Cloud plans now include free monthly inference credits. A single string update allows you to call models from: AssemblyAI Deepgram Google DeepMind OpenAI Rime

LiveKit

37,244 просмотров • 11 месяцев назад

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.
1:23

Gemini 3.1 Flash Live just dropped and it's available with LiveKit today. This is the first Gemini 3 native audio model on the Live API. Better instruction following, improved tool calling, reduced speaker drift, and support for 70+ languages. Audio in, audio out. No text conversion in between.

LiveKit

40,277 просмотров • 5 месяцев назад

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:
1:06

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

OpenAI Developers

13,411 просмотров • 1 год назад

Voice cloning is now available on LiveKit Inference. We’re launching with and Cartesia. Clone a voice once and use it across multiple TTS providers, with automatic fallback to the same voice if a provider fails mid-call. Free to create and available on all paid plans today.
4:07

Voice cloning is now available on LiveKit Inference. We’re launching with and Cartesia. Clone a voice once and use it across multiple TTS providers, with automatic fallback to the same voice if a provider fails mid-call. Free to create and available on all paid plans today.

LiveKit

11,443 просмотров • 4 месяцев назад

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:
2:27

New course: Add voice to your AI agents and applications, built with Vocal Bridge (disclosure: an AI Fund portfolio company) and taught by its CEO Ashwyn Sharma. Voice applications historically required making a hard tradeoff: using fast voice-to-voice models that sacrifice reliability, or accurate speech-to-text pipelines that add latency. This course teaches you how to build voice agents that are both reliable and fast. You'll build three types of voice-enabled applications: a voice-interactive game where voice commands and mouse clicks work together over a single channel, an agent that gains a voice in about 10 lines of code without touching its prompts or tools, and an agent that places outbound phone calls using a make_phone_call function. Skills you'll gain: - Add a voice layer to an existing agent without rewriting your prompts, RAG pipeline, or tools - Give an agent the ability to place outbound calls and stream transcripts back live - Set up voice evaluation to score calls, catch regressions, and improve quality before deployment Join and add voice to your agents without overhauling your architecture:

Andrew Ng

96,370 просмотров • 3 месяцев назад

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →
0:42

Grok's Text to Speech API is now available in LiveKit Inference. Natural, expressive voices with low-latency streaming. Multilingual in 20+ languages. Telephony and production-ready out of the box. One API key. No extra setup. →

LiveKit

159,543 просмотров • 6 месяцев назад