Загрузка видео...

Не удалось загрузить видео

На главную

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

kagigz's profile picture

Katia Gil Guzman

6,993 subscribers

316,627 просмотров • 1 год назад •via X (Twitter)

ОбразованиеНаука и технологииНовости и политика
LIVE

Anya Rossi• Live Now

Private livecam show

Комментарии: 11

Фото профиля Katia Gil Guzman
Katia Gil Guzman1 год назад

With the new WebRTC integration, you can connect to the Realtime API directly from the browser:

Фото профиля Katia Gil Guzman
Katia Gil Guzman1 год назад

Shout out to @karoliskosas for the initial idea (I have to admit, it sounded a bit crazy when I first heard it) and to the @splinetool team for building an amazing tool and helping us optimize the scene!

Фото профиля Katia Gil Guzman
Katia Gil Guzman1 год назад

@splinetool To see the full replay:

Фото профиля AssemblyAI
AssemblyAI1 год назад

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Фото профиля Nicolas Camara
Nicolas Camara1 год назад

This is awesome! Thanks for open sourcing it!

Фото профиля ZAZO
ZAZO1 год назад

It’s super good

Фото профиля Drago Nicolas Bonacich
Drago Nicolas Bonacich1 год назад

This is super cool! Thanks!

Фото профиля oAI
oAI1 год назад

@OpenAIDevs that's what's missing in the AVM

Фото профиля Mbongeni Ndlovu
Mbongeni Ndlovu1 год назад

Appreciate it

Фото профиля John Schoenith
John Schoenith1 год назад

Look at this shiz! Open-source at OpenAI! 🪩

Фото профиля 🐧 lalo adrian morales 𝕏
🐧 lalo adrian morales 𝕏1 год назад

well that was easy ! thanks!

Похожие видео

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵
1:00

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵

Craig Dennis

60,122 просмотров • 1 год назад

hey everyone! super excited play a small role in the OpenAI Realtime API launch today. we have launched an open source repo, the Realtime Console -- a React app you can hack apart and start building with immediately. here's a demo! thanks Peter Bakkum Mark Hudnall Jordan Sitkin
1:48

hey everyone! super excited play a small role in the OpenAI Realtime API launch today. we have launched an open source repo, the Realtime Console -- a React app you can hack apart and start building with immediately. here's a demo! thanks Peter Bakkum Mark Hudnall Jordan Sitkin

keith

243,232 просмотров • 1 год назад

We just updated Junie and the Codex integration in JetBrains AI! Now you can use OpenAI GPT 5.5 in all JetBrains IDEs. We ran various tests with this model but have a look yourself at one of the demo projects we built (🔊 on)
0:46

We just updated Junie and the Codex integration in JetBrains AI! Now you can use OpenAI GPT 5.5 in all JetBrains IDEs. We ran various tests with this model but have a look yourself at one of the demo projects we built (🔊 on)

JetBrains

10,966 просмотров • 3 месяцев назад

We've been having a lot of fun with the newest Mega Kangaskhan ex card that was introduced in Fantastical Parade. What new card-inspired decks have you cooked up this set? Learn more:
0:30

We've been having a lot of fun with the newest Mega Kangaskhan ex card that was introduced in Fantastical Parade. What new card-inspired decks have you cooked up this set? Learn more:

Pokémon TCG Pocket

121,013 просмотров • 6 месяцев назад

First weekend building with Fable (it also helped put together this video) Open-sourced RC car raycast controller built with three.js + cannon. It includes mobile controls + Gamepad API support. It's also been a lot of fun implementing it with 3D Gaussian Splatting. Test it out!
0:37

First weekend building with Fable (it also helped put together this video) Open-sourced RC car raycast controller built with three.js + cannon. It includes mobile controls + Gamepad API support. It's also been a lot of fun implementing it with 3D Gaussian Splatting. Test it out!

Ian Curtis

30,129 просмотров • 1 месяц назад

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!
1:18

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,448 просмотров • 3 месяцев назад

Sierra agents can be published on your web site, integrated with your mobile app, answer the phone - and now they can also be published to ChatGPT so you can directly reach hundreds of millions of consumers with your agent. Since OpenAI announced ChatGPT apps two weeks ago, we've heard from our customers that they want two things: a direct customer relationship and the ability to reach customers where they already are. We don't think you should have to choose. With Sierra, you can build once and run everywhere. Here's a demo of an agent I built to show how it works. And our blog post is here:
2:59

Sierra agents can be published on your web site, integrated with your mobile app, answer the phone - and now they can also be published to ChatGPT so you can directly reach hundreds of millions of consumers with your agent. Since OpenAI announced ChatGPT apps two weeks ago, we've heard from our customers that they want two things: a direct customer relationship and the ability to reach customers where they already are. We don't think you should have to choose. With Sierra, you can build once and run everywhere. Here's a demo of an agent I built to show how it works. And our blog post is here:

Bret Taylor

55,607 просмотров • 10 месяцев назад

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.
5:36

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.

OpenAI Developers

523,494 просмотров • 1 год назад

Say hello to “X to Voice”. An open-source app that generates a unique voice from your X/Twitter profile. Built with our Voice Design API which is live from today — where you can create a unique voice from any prompt. Try it with your profile here:
0:51

Say hello to “X to Voice”. An open-source app that generates a unique voice from your X/Twitter profile. Built with our Voice Design API which is live from today — where you can create a unique voice from any prompt. Try it with your profile here:

ElevenLabs

835,838 просмотров • 1 год назад

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵
4:17

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Ricky

16,796 просмотров • 1 год назад

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!
0:28

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!

Matthew Lam

17,674 просмотров • 2 месяцев назад

You can fold a moving bat out of just one sheet of paper! Have fun with it with your little one!
0:57

You can fold a moving bat out of just one sheet of paper! Have fun with it with your little one!

Craft Gallery

36,919 просмотров • 6 месяцев назад

🐰 i worked a lot with El Guincho. I got to listen to a lot of tracks and i was really wowed by just how fresh and new this was. One of the first thoughts i had was ‘wow, you can approach a song like this?’ and i felt a lot of pressure about how to make the best use of it. so that must be why i wanted to stay close, it was a totally a different vibe, a whole new vibe. i hope to work again and have another session with the producers and songwriters that we worked with
0:52

🐰 i worked a lot with El Guincho. I got to listen to a lot of tracks and i was really wowed by just how fresh and new this was. One of the first thoughts i had was ‘wow, you can approach a song like this?’ and i felt a lot of pressure about how to make the best use of it. so that must be why i wanted to stay close, it was a totally a different vibe, a whole new vibe. i hope to work again and have another session with the producers and songwriters that we worked with

jk.97

26,798 просмотров • 5 месяцев назад

Screaming Frog's OpenAI integration allows you to automate tons of basic SEO tasks. This step by step tutorial to shows you how to set up ChatGPT crawling. As I posted yesterday, Screaming Frog last update was one of the biggest we've seen in a long time. They've introduced a suite of new features including the ability to upload custom JavaScript and having Screaming Frog execute it. This includes a direct integration with OpenAI. To set up OpenAI crawling, here are the steps to follow:
3:46

Screaming Frog's OpenAI integration allows you to automate tons of basic SEO tasks. This step by step tutorial to shows you how to set up ChatGPT crawling. As I posted yesterday, Screaming Frog last update was one of the biggest we've seen in a long time. They've introduced a suite of new features including the ability to upload custom JavaScript and having Screaming Frog execute it. This includes a direct integration with OpenAI. To set up OpenAI crawling, here are the steps to follow:

Chris Long

30,710 просмотров • 2 лет назад

Look at this. We've made it so you can see where market makers are directly positioned with our Periscope tool. It is a must have toolset for you. See more:
1:05

Look at this. We've made it so you can see where market makers are directly positioned with our Periscope tool. It is a must have toolset for you. See more:

unusual_whales

168,327 просмотров • 12 дней назад

We've partnered with OpenAI as one of their early research preview partners for the new computer use model. With this model, AI can control a browser better than ever before 👀 Of course, we had to launch a free hosted version + open source implementation. Check it out!
0:53

We've partnered with OpenAI as one of their early research preview partners for the new computer use model. With this model, AI can control a browser better than ever before 👀 Of course, we had to launch a free hosted version + open source implementation. Check it out!

Browserbase

40,232 просмотров • 1 год назад

Today we introduced Gemini Enterprise, built with our most advanced Gemini models. It allows you to chat with your company’s documents, data and apps as well as build and deploy AI agents, all grounded in your information and context. Have a look at how it helps you build an agent for almost anything:
0:37

Today we introduced Gemini Enterprise, built with our most advanced Gemini models. It allows you to chat with your company’s documents, data and apps as well as build and deploy AI agents, all grounded in your information and context. Have a look at how it helps you build an agent for almost anything:

Sundar Pichai

1,105,836 просмотров • 10 месяцев назад

Trump: We could have a lot of fun with these guys. You can imagine when they win, how they celebrate. We don't want to talk about it. We don't want to talk about it.
0:34

Trump: We could have a lot of fun with these guys. You can imagine when they win, how they celebrate. We don't want to talk about it. We don't want to talk about it.

Acyn

30,346 просмотров • 5 месяцев назад