Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

OpenAIDevs's profile picture

OpenAI Developers

395,521 subscribers

126,312 Aufrufe • vor 1 Jahr •via X (Twitter)

Wissenschaft & TechnologieBildung
LIVE

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Shay Davidson
Shay Davidsonvor 1 Jahr

@Lemonade_Inc 👋

Profilbild von Wonderchat
Wonderchatvor 2 Jahren

Automate up to 70% of your customer support today. Save time and help your users find answers quickly. Try now at

Profilbild von Lee Twito
Lee Twitovor 1 Jahr

@Lemonade_Inc Thanks for the shoutout! It’s great working closely with OpenAI team

Profilbild von Mark Paddey
Mark Paddeyvor 1 Jahr

@Lemonade_Inc Love the free adverting for $LMND

Profilbild von Paper Bag Investor
Paper Bag Investorvor 1 Jahr

@shai_wininger @Lemonade_Inc Brilliant stuff! Thanks for sharing

Profilbild von Techikansh
Techikanshvor 1 Jahr

@Lemonade_Inc where is full o3 ???

Profilbild von Toyanç
Toyançvor 1 Jahr

@Lemonade_Inc Good but expensive.

Profilbild von Gillinghammer
Gillinghammervor 1 Jahr

@Lemonade_Inc phonescreen. ai uses it too

Profilbild von Elad Meidar
Elad Meidarvor 1 Jahr

@Lemonade_Inc We have one too. 😍

Profilbild von Evert Junior
Evert Juniorvor 1 Jahr

@Lemonade_Inc make it cheaper

Profilbild von Anthony Vyner
Anthony Vynervor 1 Jahr

@Lemonade_Inc Cool but I can imagine it’s quite expensive

Ähnliche Videos

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:
2:41

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,711 Aufrufe • vor 1 Jahr

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.
4:03

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,661,115 Aufrufe • vor 3 Monaten

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!
1:18

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,448 Aufrufe • vor 3 Monaten

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.
4:52

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.

LiveKit

12,069 Aufrufe • vor 4 Monaten

ETHGas is building the infrastructure to power Realtime Ethereum - tradable blockspace markets with low latency, high throughput, and seamless execution. 🎥 Here’s Kevin Lepsoe (Kevin Lepsoe, CEO) perspective on how we’re moving closer to Realtime Ethereum.
0:45

ETHGas is building the infrastructure to power Realtime Ethereum - tradable blockspace markets with low latency, high throughput, and seamless execution. 🎥 Here’s Kevin Lepsoe (Kevin Lepsoe, CEO) perspective on how we’re moving closer to Realtime Ethereum.

ETHGAS

64,420 Aufrufe • vor 10 Monaten

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual
0:42

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

X Freeze

13,709 Aufrufe • vor 6 Monaten

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!
0:28

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!

Matthew Lam

17,674 Aufrufe • vor 3 Monaten

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts
1:40

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts

OpenAI Developers

562,061 Aufrufe • vor 1 Jahr

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯
2:05

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯

Sawyer Hood

322,103 Aufrufe • vor 1 Jahr

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:
1:06

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

OpenAI Developers

13,411 Aufrufe • vor 1 Jahr

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.
0:47

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.

kwindla

31,843 Aufrufe • vor 1 Jahr

Give your Gemini Live Agent a phone number 📞 Our new guide shows you how to add telephony to your voice agent with Gemini 3.1 Flash Live + Twilio + Google Cloud. Delightful, multilingual AI conversations are now just a phone call away. Get the deep dive:
0:48

Give your Gemini Live Agent a phone number 📞 Our new guide shows you how to add telephony to your voice agent with Gemini 3.1 Flash Live + Twilio + Google Cloud. Delightful, multilingual AI conversations are now just a phone call away. Get the deep dive:

Google for Developers

27,532 Aufrufe • vor 3 Monaten

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours
6:15

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours

jacob paris ▲

32,463 Aufrufe • vor 1 Monat

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev
0:28

With the power of our new Audio API Beta, developers can build immersive soundscapes and enhance voice communications. From adding in-experience walkie-talkies to giving voice to NPCs, this API unlocks a whole new dimension for developers. #RobloxDev

Roblox

228,311 Aufrufe • vor 2 Jahren

"Free, accurate voice transcription in the browser using Whisper" ⚡️ I'm happy to share a modern voice-to-text app (Say) that uses in-browser AI (Whisper and T5) to offer voice transcription, text summaries and note management. Everything is done locally in a privacy-friendly way. Built with React and Transformers.js by Xenova
1:27

"Free, accurate voice transcription in the browser using Whisper" ⚡️ I'm happy to share a modern voice-to-text app (Say) that uses in-browser AI (Whisper and T5) to offer voice transcription, text summaries and note management. Everything is done locally in a privacy-friendly way. Built with React and Transformers.js by Xenova

Addy Osmani

36,822 Aufrufe • vor 1 Jahr