正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

Katia Gil Guzman

6,636 subscribers

316,548 次观看 • 1 年前 •via X (Twitter)

教育科学技术新闻政治

Anya Rossi• Live Now

Private livecam show

11 条评论

Katia Gil Guzman 的头像

Katia Gil Guzman1 年前

With the new WebRTC integration, you can connect to the Realtime API directly from the browser:

Katia Gil Guzman 的头像

Katia Gil Guzman1 年前

Shout out to @karoliskosas for the initial idea (I have to admit, it sounded a bit crazy when I first heard it) and to the @splinetool team for building an amazing tool and helping us optimize the scene!

Katia Gil Guzman 的头像

Katia Gil Guzman1 年前

@splinetool To see the full replay:

AssemblyAI 的头像

AssemblyAI1 年前

Announcing: Our most advanced speech-to-text model goes beyond accuracy to capture the real-world complexity of human conversation and deliver reliable, source-of-truth audio data. Explore Universal-2 updates 👇

Nicolas Camara 的头像

Nicolas Camara1 年前

This is awesome! Thanks for open sourcing it!

ZAZO 的头像

ZAZO1 年前

It’s super good

Drago Nicolas Bonacich 的头像

Drago Nicolas Bonacich1 年前

This is super cool! Thanks!

oAI 的头像

oAI1 年前

@OpenAIDevs that's what's missing in the AVM

Mbongeni Ndlovu 的头像

Mbongeni Ndlovu1 年前

Appreciate it

John Schoenith 的头像

John Schoenith1 年前

Look at this shiz! Open-source at OpenAI! 🪩

🐧 lalo adrian morales 𝕏 的头像

🐧 lalo adrian morales 𝕏1 年前

well that was easy ! thanks!

相关视频

1. did you know cloudflare offers a webrtc service? 2. did you know there's a whole zone clone built 100% on cloudflare? (link 👇) 3. did you know you can use it with the @openai realtime api to build multi-user ai experiencer (blog 👇) 4. so i now have an AI spanish tutor 🤪

1. did you know cloudflare offers a webrtc service? 2. did you know there's a whole zone clone built 100% on cloudflare? (link 👇) 3. did you know you can use it with the @openai realtime api to build multi-user ai experiencer (blog 👇) 4. so i now have an AI spanish tutor 🤪

rita kozlov 🐀

39,208 次观看 • 1 年前

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a template that allows for relaying through a Cloudflare Developers Worker so you can do it too! Full 📼 in 🧵

Craig Dennis

60,091 次观看 • 1 年前

hey everyone! super excited play a small role in the OpenAI Realtime API launch today. we have launched an open source repo, the Realtime Console -- a React app you can hack apart and start building with immediately. here's a demo! thanks Peter Bakkum Mark Hudnall Jordan Sitkin

hey everyone! super excited play a small role in the OpenAI Realtime API launch today. we have launched an open source repo, the Realtime Console -- a React app you can hack apart and start building with immediately. here's a demo! thanks Peter Bakkum Mark Hudnall Jordan Sitkin

keith

243,182 次观看 • 1 年前

.@openAI just introduced their gpt-realtime model -- pretty cool demo We've been building a realtime teaching capability at Sage, have a look. There's nothing else like it. (recommend watching at 2x)

.@openAI just introduced their gpt-realtime model -- pretty cool demo We've been building a realtime teaching capability at Sage, have a look. There's nothing else like it. (recommend watching at 2x)

Joe Norman

13,441 次观看 • 10 个月前

We just updated Junie and the Codex integration in JetBrains AI! Now you can use OpenAI GPT 5.5 in all JetBrains IDEs. We ran various tests with this model but have a look yourself at one of the demo projects we built (🔊 on)

We just updated Junie and the Codex integration in JetBrains AI! Now you can use OpenAI GPT 5.5 in all JetBrains IDEs. We ran various tests with this model but have a look yourself at one of the demo projects we built (🔊 on)

JetBrains

10,966 次观看 • 2 个月前

We've been having a lot of fun with the newest Mega Kangaskhan ex card that was introduced in Fantastical Parade. What new card-inspired decks have you cooked up this set? Learn more:

We've been having a lot of fun with the newest Mega Kangaskhan ex card that was introduced in Fantastical Parade. What new card-inspired decks have you cooked up this set? Learn more:

Pokémon TCG Pocket

120,899 次观看 • 4 个月前

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

44,631 次观看 • 1 个月前

Sierra agents can be published on your web site, integrated with your mobile app, answer the phone - and now they can also be published to ChatGPT so you can directly reach hundreds of millions of consumers with your agent. Since OpenAI announced ChatGPT apps two weeks ago, we've heard from our customers that they want two things: a direct customer relationship and the ability to reach customers where they already are. We don't think you should have to choose. With Sierra, you can build once and run everywhere. Here's a demo of an agent I built to show how it works. And our blog post is here:

Sierra agents can be published on your web site, integrated with your mobile app, answer the phone - and now they can also be published to ChatGPT so you can directly reach hundreds of millions of consumers with your agent. Since OpenAI announced ChatGPT apps two weeks ago, we've heard from our customers that they want two things: a direct customer relationship and the ability to reach customers where they already are. We don't think you should have to choose. With Sierra, you can build once and run everywhere. Here's a demo of an agent I built to show how it works. And our blog post is here:

Bret Taylor

55,488 次观看 • 8 个月前

Say hello to “X to Voice”. An open-source app that generates a unique voice from your X/Twitter profile. Built with our Voice Design API which is live from today — where you can create a unique voice from any prompt. Try it with your profile here:

ElevenLabs

833,464 次观看 • 1 年前

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.

That’s it. That’s the tweet. The Realtime API now supports WebRTC—you can add Realtime capabilities with just a handful of lines of code. We’ve also cut prices by 60%, added GPT-4o mini (10x cheaper than previous prices), improved voice quality, and made inputs more reliable.

OpenAI Developers

523,494 次观看 • 1 年前

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Ricky

16,796 次观看 • 1 年前

You can fold a moving bat out of just one sheet of paper! Have fun with it with your little one!

You can fold a moving bat out of just one sheet of paper! Have fun with it with your little one!

Craft Gallery

36,761 次观看 • 4 个月前

🐰 i worked a lot with El Guincho. I got to listen to a lot of tracks and i was really wowed by just how fresh and new this was. One of the first thoughts i had was ‘wow, you can approach a song like this?’ and i felt a lot of pressure about how to make the best use of it. so that must be why i wanted to stay close, it was a totally a different vibe, a whole new vibe. i hope to work again and have another session with the producers and songwriters that we worked with

🐰 i worked a lot with El Guincho. I got to listen to a lot of tracks and i was really wowed by just how fresh and new this was. One of the first thoughts i had was ‘wow, you can approach a song like this?’ and i felt a lot of pressure about how to make the best use of it. so that must be why i wanted to stay close, it was a totally a different vibe, a whole new vibe. i hope to work again and have another session with the producers and songwriters that we worked with

jk.97

26,798 次观看 • 3 个月前

Screaming Frog's OpenAI integration allows you to automate tons of basic SEO tasks. This step by step tutorial to shows you how to set up ChatGPT crawling. As I posted yesterday, Screaming Frog last update was one of the biggest we've seen in a long time. They've introduced a suite of new features including the ability to upload custom JavaScript and having Screaming Frog execute it. This includes a direct integration with OpenAI. To set up OpenAI crawling, here are the steps to follow:

Screaming Frog's OpenAI integration allows you to automate tons of basic SEO tasks. This step by step tutorial to shows you how to set up ChatGPT crawling. As I posted yesterday, Screaming Frog last update was one of the biggest we've seen in a long time. They've introduced a suite of new features including the ability to upload custom JavaScript and having Screaming Frog execute it. This includes a direct integration with OpenAI. To set up OpenAI crawling, here are the steps to follow:

Chris Long

30,710 次观看 • 2 年前

The new Realtime API with web crawling is mind-blowing! Talk in realtime with any website. Powered by the OpenAI Realtime API and 🔥 Check it out:

The new Realtime API with web crawling is mind-blowing! Talk in realtime with any website. Powered by the OpenAI Realtime API and 🔥 Check it out:

Nicolas Camara

347,089 次观看 • 1 年前

Trump: We could have a lot of fun with these guys. You can imagine when they win, how they celebrate. We don't want to talk about it. We don't want to talk about it.

Trump: We could have a lot of fun with these guys. You can imagine when they win, how they celebrate. We don't want to talk about it. We don't want to talk about it.

Acyn

30,346 次观看 • 4 个月前

We've partnered with OpenAI as one of their early research preview partners for the new computer use model. With this model, AI can control a browser better than ever before 👀 Of course, we had to launch a free hosted version + open source implementation. Check it out!

We've partnered with OpenAI as one of their early research preview partners for the new computer use model. With this model, AI can control a browser better than ever before 👀 Of course, we had to launch a free hosted version + open source implementation. Check it out!

Browserbase

40,232 次观看 • 1 年前

Today we introduced Gemini Enterprise, built with our most advanced Gemini models. It allows you to chat with your company’s documents, data and apps as well as build and deploy AI agents, all grounded in your information and context. Have a look at how it helps you build an agent for almost anything:

Today we introduced Gemini Enterprise, built with our most advanced Gemini models. It allows you to chat with your company’s documents, data and apps as well as build and deploy AI agents, all grounded in your information and context. Have a look at how it helps you build an agent for almost anything:

Sundar Pichai

1,105,484 次观看 • 8 个月前