Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

The new Realtime API from OpenAI is incredible... Watch it order 400 strawberries by actually CALLING the store with twillio. All with voice. 🍓🎤

Ty

3,075 subscribers

495,539 views • 1 year ago •via X (Twitter)

Science & Technology Education Comedy

Anya Rossi• Live Now

Private livecam show

10 Comments

Ty1 year ago

It really did order the Strawberries 😂

Ty1 year ago

Update: project strawberry is tasty

Prashant1 year ago

indeed amazing, but didn't Google had AI call assistant years ago?

Ty1 year ago

They did, but I don't see real usage of it.

Shafi1 year ago

Long back, Google showed the similar demos for call assistant booking the barber shop, this looks next generation demo, Google started the game, you took the opportunity and nailed it

Ty1 year ago

Google loves demos that don't ship

caio temer1 year ago

Google did the same in 2018 with Wavenet.

Ty1 year ago

But did it order strawberries?

NeuroFeline1 year ago

Omg why did it say "in cash"? I don't see any instructions for that. I never have cash so if it did that it would be really awkward when the delivery arrived...

Ty1 year ago

Hilarious that an ai would say it would pay in cash

Related Videos

The new Realtime API with web crawling is mind-blowing! Talk in realtime with any website. Powered by the OpenAI Realtime API and 🔥 Check it out:

The new Realtime API with web crawling is mind-blowing! Talk in realtime with any website. Powered by the OpenAI Realtime API and 🔥 Check it out:

Nicolas Camara

347,156 views • 1 year ago

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo

OpenAI Developers

417,928 views • 5 months ago

My favorite demo of the new gpt-realtime model from Matthieu LC -- Shoggoth Mini using Realtime API with image input

My favorite demo of the new gpt-realtime model from Matthieu LC -- Shoggoth Mini using Realtime API with image input

Peter Bakkum

67,871 views • 11 months ago

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯

The open ai realtime api is sick! I hooked it up to control my browser so I could browse the web with my voice 🤯

Sawyer Hood

322,103 views • 1 year ago

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

swyx

51,219 views • 11 months ago

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

Katia Gil Guzman

316,561 views • 1 year ago

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,659,244 views • 3 months ago

🚀 ChatGPT Realtime API in ACTION 🌐 Here's the application Integrated with: 🌦️ Realtime Weather 🧠 Ability to Save in Memory 🔧 Uses Function Calling Use this code and extend it from here! 💡👨‍💻

🚀 ChatGPT Realtime API in ACTION 🌐 Here's the application Integrated with: 🌦️ Realtime Weather 🧠 Ability to Save in Memory 🔧 Uses Function Calling Use this code and extend it from here! 💡👨‍💻

Mervin Praison

42,982 views • 1 year ago

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!

Matthew Lam

17,674 views • 2 months ago

with Roblox's new Audio API, you can now do proper voice transcription and interpretation! the new possibilities with this API are actually endless, it's insane. #Roblox #RobloxDev #RobloxDevs

with Roblox's new Audio API, you can now do proper voice transcription and interpretation! the new possibilities with this API are actually endless, it's insane. #Roblox #RobloxDev #RobloxDevs

jasper.creations 🔜 RDC26

354,511 views • 2 years ago

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing

🥔🥔🥔

39,508 views • 2 months ago

Voice mode in Comet uses OpenAI Developers’s new gpt-realtime-1.5. With this upgrade we were able to optimize tool call stability by over 25%, and dramatically improve voice expressiveness.

Voice mode in Comet uses OpenAI Developers’s new gpt-realtime-1.5. With this upgrade we were able to optimize tool call stability by over 25%, and dramatically improve voice expressiveness.

Comet

54,760 views • 5 months ago

What if you could create your own OpenAI Assistant with Realtime API that can: 🌐 Browse the Web 📚 Search Files (RAG) 💻 Run Code Interpreter All using open source tools. Check it out

What if you could create your own OpenAI Assistant with Realtime API that can: 🌐 Browse the Web 📚 Search Files (RAG) 💻 Run Code Interpreter All using open source tools. Check it out

FlowiseAI

23,686 views • 1 year ago

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

Developers are building great voice experiences with the Realtime API. See how Lemonade uses it to power AI Maya, their friendly and engaging voice agent. The Realtime API's automatic voice detection and low latency enable them to offer 24/7 multilingual phone support 📞

OpenAI Developers

126,292 views • 1 year ago

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts

The Realtime API is officially out of beta and ready for your production voice agents! We’re also introducing gpt-realtime—our most advanced speech-to-speech model yet—plus new voices and API capabilities: 🔌 Remote MCPs 🖼️ Image input 📞 SIP phone calling ♻️ Reusable prompts

OpenAI Developers

561,897 views • 11 months ago

"ALL THE WAY DOWN" BY Dance Gavin Dance🍓 IS OUT NOW 🍓 Stream it and pre-order their new album PANTHEON (out 9.12.25)

"ALL THE WAY DOWN" BY Dance Gavin Dance🍓 IS OUT NOW 🍓 Stream it and pre-order their new album PANTHEON (out 9.12.25)

Rise Records

31,896 views • 1 year ago

The secret is out! In my All-New Agent Kyra avatar with the All New Titan EyeX 2.0. Titan EyeX 2.0 was the perfect smart companion for this high-stakes secret mission with its handsfree calling, real-time voice navigation, HD Music with equalizer, and many more smart features! Check it out on the Titan Eye+ App, Store & Website. #SmartEyewear #TitanEyeX #Titan

Kyra

457,714 views • 2 years ago

Introducing AI Voice + 3D in real-time. 🥕 Integrate with OpenAI Real-time API ✨ Create conversational AI experiences 🌳 Drive states, variables, morph targets 🍓 Trigger events and actions from instructions Make your own AI Voice 3D experiences with Spline.

Introducing AI Voice + 3D in real-time. 🥕 Integrate with OpenAI Real-time API ✨ Create conversational AI experiences 🌳 Drive states, variables, morph targets 🍓 Trigger events and actions from instructions Make your own AI Voice 3D experiences with Spline.

Spline

105,889 views • 1 year ago