Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Today we released our Voice Agent API, the world’s only enterprise-ready, real-time, and cost-effective Conversational AI API. If you're building voice agents and you’re tired of the demo day stitching: STT → LLM → Orchestration → TTS → Hoping it works We killed it with...

Deepgram

9,742 subscribers

10,695 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Yesterday at AI Pulse we plugged our real-time STT + TTS API into reachymini and turned it into a live, unscripted conversational robot. Voice, personality, language, gestures, all controlled by speech. Big shoutout to Pollen Robotics and Hugging Face for making this cool little guy.

Yesterday at AI Pulse we plugged our real-time STT + TTS API into reachymini and turned it into a live, unscripted conversational robot. Voice, personality, language, gestures, all controlled by speech. Big shoutout to Pollen Robotics and Hugging Face for making this cool little guy.

Gradium

67,835 Aufrufe • vor 7 Monaten

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

X Freeze

13,709 Aufrufe • vor 4 Monaten

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇

Stream

224,782 Aufrufe • vor 11 Monaten

We just shipped something nobody else has. Our STT API doesn't just transcribe, it returns a full voice profile in the same response: emotion, accent, age, pitch, style, each with a confidence score, all in one call. When you feed that into our Realtime API, the LLM decides not just what to say but how to say it. It adds steering tags that our TTS-2 model picks up and uses to guide how it speaks. So, if a user sounds frustrated, the voice responds with empathy. If they're excited, it matches that energy. Here's our very own Clint McLean walking you through how the full pipeline works:

Inworld AI

250,378 Aufrufe • vor 2 Monaten

AI orchestration, gamified. Our newly released Agents API lets you run Claude Code, Gemini, and Codex solo or in parallel. Go multi-agent and a chairman LLM evaluates each solution, picks the winner. Changes deploy instantly to @Vercel.

AI orchestration, gamified. Our newly released Agents API lets you run Claude Code, Gemini, and Codex solo or in parallel. Go multi-agent and a chairman LLM evaluates each solution, picks the winner. Changes deploy instantly to @Vercel.

BLACKBOX AI

45,422 Aufrufe • vor 5 Monaten

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,616 Aufrufe • vor 2 Jahren

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

Noah MacCallum

73,415 Aufrufe • vor 1 Jahr

Introducing the Responses API: the new primitive of the OpenAI API. It is the culmination of 2 years of learnings designing the OpenAI API, and the foundation of our next chapter of building agents. 🧵Here’s the story of how we designed it:

Introducing the Responses API: the new primitive of the OpenAI API. It is the culmination of 2 years of learnings designing the OpenAI API, and the foundation of our next chapter of building agents. 🧵Here’s the story of how we designed it:

Atty Eleti

1,987,240 Aufrufe • vor 1 Jahr

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Deepgram

726,214 Aufrufe • vor 1 Jahr

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

OpenAI Developers

126,135 Aufrufe • vor 1 Jahr

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 Aufrufe • vor 1 Jahr

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟

Shawn Shen

530,527 Aufrufe • vor 11 Monaten

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

OpenAI Developers

13,411 Aufrufe • vor 1 Jahr

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

Santiago

185,560 Aufrufe • vor 2 Jahren

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

Together AI

21,814 Aufrufe • vor 1 Monat

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Santiago

230,594 Aufrufe • vor 1 Jahr

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 Aufrufe • vor 3 Monaten

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,648,735 Aufrufe • vor 2 Monaten

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,484 Aufrufe • vor 1 Jahr