正在加载视频...

视频加载失败

返回首页

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

OpenAIDevs's profile picture

OpenAI Developers

363,714 subscribers

126,086 次观看 • 1 年前 •via X (Twitter)

科学技术教育
LIVE

Anya Rossi• Live Now

Private livecam show

11 条评论

Shay Davidson 的头像
Shay Davidson1 年前

@Lemonade_Inc 👋

Wonderchat 的头像
Wonderchat2 年前

Automate up to 70% of your customer support today. Save time and help your users find answers quickly. Try now at

Lee Twito 的头像
Lee Twito1 年前

@Lemonade_Inc Thanks for the shoutout! It’s great working closely with OpenAI team

Mark Paddey 的头像
Mark Paddey1 年前

@Lemonade_Inc Love the free adverting for $LMND

Paper Bag Investor 的头像
Paper Bag Investor1 年前

@shai_wininger @Lemonade_Inc Brilliant stuff! Thanks for sharing

Techikansh 的头像
Techikansh1 年前

@Lemonade_Inc where is full o3 ???

Toyanç 的头像
Toyanç1 年前

@Lemonade_Inc Good but expensive.

Gillinghammer 的头像
Gillinghammer1 年前

@Lemonade_Inc phonescreen. ai uses it too

Elad Meidar 的头像
Elad Meidar1 年前

@Lemonade_Inc We have one too. 😍

Evert Junior 的头像
Evert Junior1 年前

@Lemonade_Inc make it cheaper

Anthony Vyner 的头像
Anthony Vyner1 年前

@Lemonade_Inc Cool but I can imagine it’s quite expensive

相关视频

Alex Gamble Perplexity .Intercom is using the Realtime API to power Fin Voice, their AI Agent for phone support. The new model follows call scripts better, executes function calls more consistently, and hallucinates less, helping provide human-quality AI support, 24/7.
1:00

Alex Gamble Perplexity .Intercom is using the Realtime API to power Fin Voice, their AI Agent for phone support. The new model follows call scripts better, executes function calls more consistently, and hallucinates less, helping provide human-quality AI support, 24/7.

OpenAI Developers

23,409 次观看 • 1 年前

Here are the experiences developers are building with the Realtime API:
2:31

Here are the experiences developers are building with the Realtime API:

OpenAI Developers

36,067 次观看 • 27 天前

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo
1:46

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo

OpenAI Developers

417,595 次观看 • 4 个月前

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:
2:41

Learn to build conversational AI voice agents in "Building AI Voice Agents for Production", created in collaboration with LiveKit and RealAvatar, and taught by dsa (Co-founder & CEO of LiveKit), Shayne (Developer Advocate, LiveKit), and Nedelina Teneva (Head of AI at RealAvatar, an AI Fund portfolio company). Voice agents combine speech and reasoning capabilities to enable real-time conversations. They're already being used to support customer service, to improve accessibility in healthcare, for entertainment applications, and for talk therapy. In this course, you’ll learn to build voice agents that listen, reason, and respond naturally. You’ll follow the architecture used to create the "AI Andrew" Avatar, a collaborative project between and RealAvatar that responds to users in what sounds like my voice. You’ll build a voice agent from scratch and deploy it to the cloud, enabling support for many simultaneous users. What you’ll learn: - Understand the fundamentals of voice agents, including key components like speech-to-text (STT), text-to-speech (TTS), and LLMs, and how latency is introduced at each layer. - Explore voice agent architectures and the trade-offs between modular pipelines and speech-to-speech APIs. - Explore how platforms like LiveKit mitigate latency issues with optimized networking infrastructure and low-latency communication protocols. - Learn how to connect client devices to voice agents using WebRTC—and why it outperforms HTTP and WebSocket for low-latency audio streaming. - Incorporate voice activity detection (VAD), end-of-turn detection, and context management to detect turns, handle interruptions, and manage conversational flow. - Understand the trade-offs between latency, quality, and cost in an example in which you build a voice agent and change its voice. - Equip your agent with metrics to measure latency at each stage of the voice pipeline and learn the key levers you can pull to make your agent faster and more responsive. The voice agents built in this course also incorporate voice technology from , a supporting contributor to the project. By the end of this course, you'll have learned the components of an AI voice agent pipeline, combined them into a system with low-latency communication, and deployed them on cloud infrastructure so it scales to many users. I’m looking forward to seeing what voice agents you build from this course! Please sign up here:

Andrew Ng

87,484 次观看 • 1 年前

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.
4:03

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,628,862 次观看 • 1 个月前

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!
1:18

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

44,631 次观看 • 1 个月前

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.
4:52

We shipped Agent Console, a realtime debugging surface for voice agents. Talk to your agent and see the entire pipeline live, from audio and latency to tool calls, transcripts, and participant state. Available now in the LiveKit Cloud dashboard.

LiveKit

11,915 次观看 • 2 个月前

ETHGas is building the infrastructure to power Realtime Ethereum - tradable blockspace markets with low latency, high throughput, and seamless execution. 🎥 Here’s Kevin Lepsoe (Kevin Lepsoe, CEO) perspective on how we’re moving closer to Realtime Ethereum.
0:45

ETHGas is building the infrastructure to power Realtime Ethereum - tradable blockspace markets with low latency, high throughput, and seamless execution. 🎥 Here’s Kevin Lepsoe (Kevin Lepsoe, CEO) perspective on how we’re moving closer to Realtime Ethereum.

ETHGAS

64,420 次观看 • 8 个月前

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual
0:42

Try the Grok Voice Agent API - the most powerful, most natural human-sounding AI in the world 🎙️ Start integrating it into your apps today. The API page has just been updated with voice previews 👉 Just listen, pick the voice you love, and start building Real-time & Multilingual

X Freeze

13,709 次观看 • 4 个月前

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts
1:40

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts

OpenAI Developers

561,727 次观看 • 10 个月前

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯
2:05

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯

Sawyer Hood

322,062 次观看 • 1 年前

We’re bringing ultra-responsive voice AI to life with @LiveKit For voice agents, speed matters. See what we built to showcase how you can build low latency voice apps using PlayAI and LiveKit
1:10

We’re bringing ultra-responsive voice AI to life with @LiveKit For voice agents, speed matters. See what we built to showcase how you can build low latency voice apps using PlayAI and LiveKit

PlayAI

13,840 次观看 • 1 年前

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me
10:41

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

swyx

51,219 次观看 • 10 个月前

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:
1:06

Next, the Traces dashboard now supports Realtime API sessions, letting you visualize voice agent runs, including audio input/output, tool invocations, and interruptions, whether created via the API or the Agents SDK. Here's Alex Gamble to show you how it works:

OpenAI Developers

13,411 次观看 • 1 年前

Here’s OpenAI’s latest realtime voice model, GPT-Realtime-2, wired up to OpenClaw. It’s amazing. Realtime continuous chat and fast OpenClaw agent action on real tasks. Truly excellent.
1:35

Here’s OpenAI’s latest realtime voice model, GPT-Realtime-2, wired up to OpenClaw. It’s amazing. Realtime continuous chat and fast OpenClaw agent action on real tasks. Truly excellent.

Ben Badejo

142,537 次观看 • 1 个月前

Give your Gemini Live Agent a phone number 📞 Our new guide shows you how to add telephony to your voice agent with Gemini 3.1 Flash Live + Twilio + Google Cloud. Delightful, multilingual AI conversations are now just a phone call away. Get the deep dive:
0:48

Give your Gemini Live Agent a phone number 📞 Our new guide shows you how to add telephony to your voice agent with Gemini 3.1 Flash Live + Twilio + Google Cloud. Delightful, multilingual AI conversations are now just a phone call away. Get the deep dive:

Google for Developers

27,443 次观看 • 2 个月前

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.
0:47

🔊🔛🔥 ... Groq Inc launched voice generation today. GroqCloud now has realtime transcription, LLMs, *and* text-to-speech. You can build super-responsive, ultra low-latency voice agents end-to-end entirely on Groq! At Daily, we're big fans of Groq's fast, low-latency inference. Pipecat AI supports all the Groq models, including the new voice model. Lately, we've been obsessively playing a voice chat game that Mark Backman wrote. (My high score is 6, so far.) Here's Mark, with Groq's `Celeste-PlayAI` voice.

kwindla

31,791 次观看 • 1 年前

See Native Audio in action 🤠🦊 Our "Mumble Jumble" demo in Google AI Studio showcases the Live API's advanced voice capabilities: natural flow, distinct tone, emotion, and multilingual support.
1:10

See Native Audio in action 🤠🦊 Our "Mumble Jumble" demo in Google AI Studio showcases the Live API's advanced voice capabilities: natural flow, distinct tone, emotion, and multilingual support.

Google AI Developers

22,835 次观看 • 1 年前