Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

Today we released our Voice Agent API, the world’s only enterprise-ready, real-time, and cost-effective Conversational AI API. If you're building voice agents and you’re tired of the demo day stitching: STT → LLM → Orchestration → TTS → Hoping it works We killed it with...

Deepgram

11,243 subscribers

11,229 Aufrufe • vor 1 Jahr •via X (Twitter)

Anya Rossi• Live Now

Private livecam show

10 Kommentare

Profilbild von Deepgram

Deepgramvor 1 Jahr

-Unified STT + LLM orchestration + TTS, BYO models or use ours -Model-level control for barge-in, turn-taking, mid-session -No black box limitations - full visibility and control into orchestration, deployment and models -Prod-ready scale

Profilbild von Deepgram

Deepgramvor 1 Jahr

This is the real time runtime layer for production-grade, scalable voice agents. We’re excited to see what you build. Learn more: Sign up to start building:

Profilbild von Adi

Adivor 1 Jahr

Exciting launch. I’ve seen how messy STT → LLM → orchestration → TTS pipelines can get, so the idea of a single API for voice agents is super compelling. Definitely planning to do a price analysis soon to see how it scales vs building it all out.

Profilbild von Robert Youssef

Robert Youssefvor 1 Jahr

interesting concept, but remember, a single api won't solve all the common pitfalls of voice agents. automation is still a tricky business. keep it simple and focused.

Profilbild von swiecki

swieckivor 1 Jahr

Nova 4 when

Profilbild von Deepgram

Deepgramvor 1 Jahr

We're cooking up something this quarter. Stay tuned.

Profilbild von Harshal

Harshalvor 1 Jahr

Incredible work!

Profilbild von Aaliya

Aaliyavor 1 Jahr

This is a big one! Real-time voice agents that just work — no messy setup. Excited to see how builders use it.

Profilbild von Jon Osman II

Jon Osman IIvor 1 Jahr

What is the best front end and back end for deploying live? I have been using vercel and render and railway and have been having a nightmare of a time

Profilbild von Neural

Neuralvor 1 Jahr

Impressive launch, @DeepgramAI! Streamlining real-time voice agents with enterprise-grade efficiency eliminates the stitching hassle, unlocking seamless conversational AI on a global scale.

Ähnliche Videos

Yesterday at AI Pulse we plugged our real-time STT + TTS API into reachymini and turned it into a live, unscripted conversational robot. Voice, personality, language, gestures, all controlled by speech. Big shoutout to Pollen Robotics and Hugging Face for making this cool little guy.

Yesterday at AI Pulse we plugged our real-time STT + TTS API into reachymini and turned it into a live, unscripted conversational robot. Voice, personality, language, gestures, all controlled by speech. Big shoutout to Pollen Robotics and Hugging Face for making this cool little guy.

Gradium

67,835 Aufrufe • vor 9 Monaten

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

X Freeze

13,709 Aufrufe • vor 7 Monaten

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇

Building real-time voice AI just got a lot easier 🤖✨ Introducing our new Python AI SDK for building real-time AI integrations directly into Stream Video. With out-of-the-box integrations with , Deepgram, , OpenAI, Moonshine AI, and more, developers can mix and match between real-time Voice AI, TTS or STT models. Get started 👇

Stream

224,788 Aufrufe • vor 1 Jahr

Crawling websites with the Realtime API 🗣️ Steer an AI agent with your voice as it crawls and browses websites in real time. Powered by OpenAI's new Realtime API, function calling, and . Check it out:

Crawling websites with the Realtime API 🗣️ Steer an AI agent with your voice as it crawls and browses websites in real time. Powered by OpenAI's new Realtime API, function calling, and . Check it out:

Eric Ciarla (hiring)

49,090 Aufrufe • vor 1 Jahr

We just shipped something nobody else has. Our STT API doesn't just transcribe, it returns a full voice profile in the same response: emotion, accent, age, pitch, style, each with a confidence score, all in one call. When you feed that into our Realtime API, the LLM decides not just what to say but how to say it. It adds steering tags that our TTS-2 model picks up and uses to guide how it speaks. So, if a user sounds frustrated, the voice responds with empathy. If they're excited, it matches that energy. Here's our very own Clint McLean walking you through how the full pipeline works:

Inworld AI

250,703 Aufrufe • vor 4 Monaten

AI orchestration, gamified. Our newly released Agents API lets you run Claude Code, Gemini, and Codex solo or in parallel. Go multi-agent and a chairman LLM evaluates each solution, picks the winner. Changes deploy instantly to @Vercel.

AI orchestration, gamified. Our newly released Agents API lets you run Claude Code, Gemini, and Codex solo or in parallel. Go multi-agent and a chairman LLM evaluates each solution, picks the winner. Changes deploy instantly to @Vercel.

BLACKBOX AI

45,422 Aufrufe • vor 8 Monaten

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

Introducing — a new conversational Voice AI platform and API for creating human-like voice agents and voice interfaces. Powered by our new Large Dialogue Model (LDM), Play LDM 1.0 makes the speech generation contextual; handles turn-taking, interruption, voice energy and emotion modulation for a natural, fluid, human conversations in real-time.

PlayAI

105,659 Aufrufe • vor 2 Jahren

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

I've been building voice agents for the last 6mo and I think the chat-supervisor pattern is a game changer. Stitched model (STT-LLM-TTS) is slow, but realtime audio models aren't (yet) as smart as text. This has the best of both worlds. Here's how it works:

Noah MacCallum

73,462 Aufrufe • vor 1 Jahr

Introducing the Responses API: the new primitive of the OpenAI API. It is the culmination of 2 years of learnings designing the OpenAI API, and the foundation of our next chapter of building agents. 🧵Here’s the story of how we designed it:

Introducing the Responses API: the new primitive of the OpenAI API. It is the culmination of 2 years of learnings designing the OpenAI API, and the foundation of our next chapter of building agents. 🧵Here’s the story of how we designed it:

Atty Eleti

1,988,633 Aufrufe • vor 1 Jahr

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Introducing our unified Voice Agent API! ⚡️ Quickly and easily build voice agents that listen, think, and respond in real-time, as naturally as a human can. Powered by the industry's fastest, most performant speech recognition and voice synthesis models to deliver: -Natural-sounding real-time conversations -Revolutionary interruption handling -Choice of open source, closed source, or BYO LLM -Low cost See our drive-thru agent in action, smoothly handling interruptions and complex orders in the noisy streets of SF. Learn how to get access (🧵)

Deepgram

726,214 Aufrufe • vor 2 Jahren

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

OpenAI Developers

126,348 Aufrufe • vor 1 Jahr

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

I built a service desk agent using ElevenLabs’ new Conversational AI Agents feature. Watch the video to see how responsive it is! Previously, I used ElevenLabs for cloning my voice and used my generated voice for narrations in some of my youtube videos. This feature takes elevenlabs' voice AI to a whole new level! It simplifies systems that used to require separate TTS (text-to-speech) and STT (speech-to-text) processes for both sides of the conversation. Now, it’s much simpler! Create your own agent here What will you create with this?

Melvin Vivas

27,722 Aufrufe • vor 1 Jahr

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

OpenAI Developers

13,411 Aufrufe • vor 1 Jahr

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟

NOW you can BUILD REAL Multi-Modal Agents with our API! 🚀 Excited to announce our API is now publicly available Memories.ai 😃 Memories.ai is building the visual memory layer for AI, it enables AI to see and remember like humans do. 2025 is the year of agents, 2026 is the year of multi-modal agents! 🌟

Shawn Shen

530,644 Aufrufe • vor 1 Jahr

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

This is the fastest text-to-speech and speech-to-text API out there. It's under 250 ms to first-byte latency. That's what we need to deploy conversational AI applications everywhere! (I can't wait for the death of automated voice machines.) Look at the attached video. For the first time, I could have a conversation with an AI agent in real time without awkward pauses. This technology is Aura from Deepgram. It's the fastest text-to-speech option I've seen. Here is a GitHub repository with the demo in the video: You can use it to build a conversational AI application using natural voice. You'll need a Deepgram API Key and an OpenAI API Key. Thanks to Deepgram for giving me access to Aura and collaborating with me on this post. If you want to learn more about Aura, here is the announcement post:

Santiago

185,640 Aufrufe • vor 2 Jahren

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

We added 600+ new voices on Together AI! Introducing MiniMax Speech 2.8 Turbo on Together AI, an enterprise TTS model for expressive real-time voice agents. AI natives can now deploy MiniMax (official) Speech 2.8 Turbo on Together AI dedicated infrastructure, and try the voices directly in voice finder.

Together AI

21,814 Aufrufe • vor 4 Monaten

Agents shouldn't see your secrets. Today, most deployments hand the agent a real API key and hope for the best. That's why we're launching Infisical Agent Proxy. You give an agent a fake API key. The agent uses that key and the proxy swaps it for the real one at the network boundary before forwarding it outbound to its destination. An agent can't leak a secret it never sees. Build and deploy AI agents securely with Infisical Agent Proxy.

Agents shouldn't see your secrets. Today, most deployments hand the agent a real API key and hope for the best. That's why we're launching Infisical Agent Proxy. You give an agent a fake API key. The agent uses that key and the proxy swaps it for the real one at the network boundary before forwarding it outbound to its destination. An agent can't leak a secret it never sees. Build and deploy AI agents securely with Infisical Agent Proxy.

Infisical

28,086 Aufrufe • vor 1 Monat

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Introducing Lightning V3 - it beats every model we tested against. ElevenLabs, Cartesia, OpenAI. Lightning sets a new SOTA with V3 in conversational text-to-speech. → Highest MOS score for conversational TTS at 3.9 → ~76% win rate vs gpt-4o-mini-tts on naturalness → 15 languages with mid-sentence code-switching → Built from scratch for voice agents, not read-aloud Every TTS model sounds clean in a demo. You type a sentence and you get beautiful audio. Voice agents don't work that way. They stream. They're generating audio in real-time chunks with half the context missing. That's where everything breaks. A great reading voice and a great conversational voice are fundamentally different things. A conversational voice has to sound like it's thinking - with the pauses, the rhythm shifts, the reactions. It has to handle the way real people actually talk, including switching languages mid-sentence. That's what V3 does. V3.1 also ships voice cloning. 5 to 15 seconds of audio, no fine-tuning, production-grade clone across 15 languages. Blog link in the comments.

Sudarshan Kamath

71,298 Aufrufe • vor 6 Monaten

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,666,276 Aufrufe • vor 4 Monaten

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Postman is going all-in on AI! Their AI Agent Builder is live (and it's pretty powerful!) Postman's API Network has 100,000+ APIs and they just released a suite of tools for building AI Agents that can automatically discover and connect to any of these APIs. Think about it for a second: You can now build an AI agent that searches the network, discovers an API, processes its documentation, connects to it, and evaluates whether everything worked at the end of the process. This is a huge deal. Every person I know uses the Postman client to work with APIs. Now, they will have access to the AI Agent Builder, a complete suite for designing, building, testing, and deploying agents. I've built a few simple agents myself, and it's tough. The ability to discover and use an API automatically is really exciting (and a huge time saver if it works as promised!) In collaboration with the Postman team, who is sponsoring this post, I recorded a video with my thoughts about the Postman AI Agent Builder.

Santiago

230,647 Aufrufe • vor 1 Jahr