正在加载视频...

视频加载失败

加载此视频时出现问题。这可能是由于临时网络问题，或视频可能不可用。

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a... show more

Craig Dennis

7,414 subscribers

60,122 次观看 • 1 年前 •via X (Twitter)

教育游戏科学技术

Anya Rossi• Live Now

Private livecam show

11 条评论

Craig Dennis 的头像

Craig Dennis1 年前

Full 📼

mobilewatcher2 的头像

mobilewatcher21 年前

Cloudless remote access to the app | With this app you are in control. Pay for the app and get Detect Events and Smoke Alarm, Record Video. Text and email will increase awareness. Access remotely using QR code on MobileWatcher2 ™ Main screen top.

Josh Larson 的头像

Josh Larson1 年前

@OpenAI I went from "wow this is neat" to "gosh I should build something with this!" to "I MUST buy a robot hand"

Craig Dennis 的头像

Craig Dennis1 年前

@OpenAI Put it on your holiday list! Link in the repo!

Alex Volkov (Thursd/AI) 的头像

Alex Volkov (Thursd/AI)1 年前

@OpenAI This is SO dope! 🔥

Brian Ball 的头像

Brian Ball1 年前

@OpenAI "It's kinda hard to read.. can you fix that?"

Craig Dennis 的头像

Craig Dennis1 年前

@OpenAI Bonkers right?!!!

William Allen 的头像

William Allen1 年前

@OpenAI 🤖🤯!!

Ray Fernando 的头像

Ray Fernando1 年前

@OpenAI Wow!! This is so cool!!

jensen 的头像

jensen1 年前

@OpenAI This is great. Made a relay using DO a few months ago, but WebRTC makes way more sense.

Ryan Morrison 🇺🇸 🇿🇦 的头像

Ryan Morrison 🇺🇸 🇿🇦1 年前

@OpenAI Very cool

相关视频

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Ricky

16,796 次观看 • 1 年前

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

Katia Gil Guzman

316,561 次观看 • 1 年前

Wow, Anthropic Claude Code is AWESOME I built a Cloudflare Developers Workers AI-powered app in just a few minutes, letting Claude do 99% of the work Check it out ⬇️ 🧵with a few other resources too

Wow, Anthropic Claude Code is AWESOME I built a Cloudflare Developers Workers AI-powered app in just a few minutes, letting Claude do 99% of the work Check it out ⬇️ 🧵with a few other resources too

Kristian

34,661 次观看 • 1 年前

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,125 次观看 • 2 个月前

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 次观看 • 2 个月前

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

swyx

51,219 次观看 • 11 个月前

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

ilan bigio

74,247 次观看 • 1 年前

I love calling out these accounts from overseas that have zero clue what it takes to purchase a firearm here in the United States. In fact, purchasing a firearm is one of the most strict things that you can do here. So let’s make it as easy to purchase a firearm as it is to vote.

I love calling out these accounts from overseas that have zero clue what it takes to purchase a firearm here in the United States. In fact, purchasing a firearm is one of the most strict things that you can do here. So let’s make it as easy to purchase a firearm as it is to vote.

Steve 🇺🇸

23,181 次观看 • 1 个月前

Last week we released OpenAI Developers gpt-realtime our latest speech-to-speech model. Prompting S2S models can be extremely powerful. To get the most out of the model we compiled a series of prompting tips of what we saw work with early customers. To present them here's Cedar our new voice in gpt-realtime walk you through it. If you want to read it yourself check the links below 👇

Last week we released OpenAI Developers gpt-realtime our latest speech-to-speech model. Prompting S2S models can be extremely powerful. To get the most out of the model we compiled a series of prompting tips of what we saw work with early customers. To present them here's Cedar our new voice in gpt-realtime walk you through it. If you want to read it yourself check the links below 👇

dominik kundel

66,904 次观看 • 11 个月前

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.

Allie K. Miller

80,345 次观看 • 11 个月前

OPENAI 🔥: The built-in web browser in the ChatGPT app is becoming more mature. Now it supports URL suggestions during typing. Besides that, the ChatGPT Chrome extension can now reference open tabs, highlight to ask, and more! I may need to try it as a default 👀

OPENAI 🔥: The built-in web browser in the ChatGPT app is becoming more mature. Now it supports URL suggestions during typing. Besides that, the ChatGPT Chrome extension can now reference open tabs, highlight to ask, and more! I may need to try it as a default 👀

🚨 AI News | TestingCatalog

62,691 次观看 • 3 天前

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

3,741,838 次观看 • 2 年前

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

3,069,494 次观看 • 2 年前

i hate the way tool calling works today, so i built a fix for it its called `executor` and it lets your agent run code to call any API / MCP / GraphQL server rather than installing CLIs this is a soft launch, you can try it with npm i -g executor but im still making it great

i hate the way tool calling works today, so i built a fix for it its called `executor` and it lets your agent run code to call any API / MCP / GraphQL server rather than installing CLIs this is a soft launch, you can try it with npm i -g executor but im still making it great

Rhys

129,065 次观看 • 4 个月前

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

Binh Pham

120,916 次观看 • 1 个月前

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

5,826,968 次观看 • 2 年前

Day 13 Update - Aida the browser AI assistant. Aida can now think and execute plans - watch it scrape the current tab for all video titles on Rahul Mathur's Breakdown channel and save it as a txt file. Note that none of this code is written in advance or just a tool call, it writes code in realtime and dynamically executes it in the context of the browser. - Worked on the DOM Engine which provides better context to the assistant for dynamic code execution. - Wasn't satisfied with the design in the last update, tried to make it better. Whats next? Getting it to the hands of users. I've been gate-keeping this for too long. Made an accountability bet with Yogini Bende today to release it in a day.

Day 13 Update - Aida the browser AI assistant. Aida can now think and execute plans - watch it scrape the current tab for all video titles on Rahul Mathur's Breakdown channel and save it as a txt file. Note that none of this code is written in advance or just a tool call, it writes code in realtime and dynamically executes it in the context of the browser. - Worked on the DOM Engine which provides better context to the assistant for dynamic code execution. - Wasn't satisfied with the design in the last update, tried to make it better. Whats next? Getting it to the hands of users. I've been gate-keeping this for too long. Made an accountability bet with Yogini Bende today to release it in a day.

Nakshatra Saxena

10,971 次观看 • 1 年前