Video wird geladen...

Video konnte nicht geladen werden

Beim Laden dieses Videos ist ein Problem aufgetreten. Dies könnte an einem vorübergehenden Netzwerkproblem liegen oder das Video ist möglicherweise nicht verfügbar.

I've been having a ton of fun exploring the Realtime API from OpenAI. Today they just launched the ability to connect to it over WebRTC! 🤖🖐️ It supports Tool Calling, so check out what that looks like in Realtime function calling in any browser based app. I built a... show more

Craig Dennis

7,414 subscribers

60,122 Aufrufe • vor 1 Jahr •via X (Twitter)

Bildung Gaming Wissenschaft & Technologie

Anya Rossi• Live Now

Private livecam show

11 Kommentare

Profilbild von Craig Dennis

Craig Dennisvor 1 Jahr

Full 📼

Profilbild von mobilewatcher2

mobilewatcher2vor 1 Jahr

Cloudless remote access to the app | With this app you are in control. Pay for the app and get Detect Events and Smoke Alarm, Record Video. Text and email will increase awareness. Access remotely using QR code on MobileWatcher2 ™ Main screen top.

Profilbild von Josh Larson

Josh Larsonvor 1 Jahr

@OpenAI I went from "wow this is neat" to "gosh I should build something with this!" to "I MUST buy a robot hand"

Profilbild von Craig Dennis

Craig Dennisvor 1 Jahr

@OpenAI Put it on your holiday list! Link in the repo!

Profilbild von Alex Volkov (Thursd/AI)

Alex Volkov (Thursd/AI)vor 1 Jahr

@OpenAI This is SO dope! 🔥

Profilbild von Brian Ball

Brian Ballvor 1 Jahr

@OpenAI "It's kinda hard to read.. can you fix that?"

Profilbild von Craig Dennis

Craig Dennisvor 1 Jahr

@OpenAI Bonkers right?!!!

Profilbild von William Allen

William Allenvor 1 Jahr

@OpenAI 🤖🤯!!

Profilbild von Ray Fernando

Ray Fernandovor 1 Jahr

@OpenAI Wow!! This is so cool!!

Profilbild von jensen

jensenvor 1 Jahr

@OpenAI This is great. Made a relay using DO a few months ago, but WebRTC makes way more sense.

Profilbild von Ryan Morrison 🇺🇸 🇿🇦

Ryan Morrison 🇺🇸 🇿🇦vor 1 Jahr

@OpenAI Very cool

Ähnliche Videos

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Who knew that inviting AI into your video chats could be fun && functional? We used Cloudflare Developers Calls and the OpenAI Realtime API with WebRTC to add AI to our open source Orange Meets demo app. I forked it to make my own murder mystery app 😈 Code and details in 🧵

Ricky

16,796 Aufrufe • vor 1 Jahr

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

Katia Gil Guzman

316,561 Aufrufe • vor 1 Jahr

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,125 Aufrufe • vor 2 Monaten

Wow, Anthropic Claude Code is AWESOME I built a Cloudflare Developers Workers AI-powered app in just a few minutes, letting Claude do 99% of the work Check it out ⬇️ 🧵with a few other resources too

Wow, Anthropic Claude Code is AWESOME I built a Cloudflare Developers Workers AI-powered app in just a few minutes, letting Claude do 99% of the work Check it out ⬇️ 🧵with a few other resources too

Kristian

34,661 Aufrufe • vor 1 Jahr

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 Aufrufe • vor 2 Monaten

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

Voice is the OG modality. So excited for image inputs, function calling & MCP support in the Realtime API GA! `gpt-realtime` is a lot more natural and expressive, and every time a SOTA voice model is released, you know what I gotta do... Here is the new voice Marin, on KaraokeBench! scores 3 out of 7 again from me

swyx

51,219 Aufrufe • vor 11 Monaten

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

another realtime api trick i stumbled upon 💡 to prevent the model from "jumping in" to speak whenever you pause, you can give it a stay_silent() function that does nothing it'll call it when it knows you haven't finished your thought, even if you pause - full prompt below👇 -

ilan bigio

74,247 Aufrufe • vor 1 Jahr

I love calling out these accounts from overseas that have zero clue what it takes to purchase a firearm here in the United States. In fact, purchasing a firearm is one of the most strict things that you can do here. So let’s make it as easy to purchase a firearm as it is to vote.

I love calling out these accounts from overseas that have zero clue what it takes to purchase a firearm here in the United States. In fact, purchasing a firearm is one of the most strict things that you can do here. So let’s make it as easy to purchase a firearm as it is to vote.

Steve 🇺🇸

23,181 Aufrufe • vor 1 Monat

Last week we released OpenAI Developers gpt-realtime our latest speech-to-speech model. Prompting S2S models can be extremely powerful. To get the most out of the model we compiled a series of prompting tips of what we saw work with early customers. To present them here's Cedar our new voice in gpt-realtime walk you through it. If you want to read it yourself check the links below 👇

Last week we released OpenAI Developers gpt-realtime our latest speech-to-speech model. Prompting S2S models can be extremely powerful. To get the most out of the model we compiled a series of prompting tips of what we saw work with early customers. To present them here's Cedar our new voice in gpt-realtime walk you through it. If you want to read it yourself check the links below 👇

dominik kundel

66,904 Aufrufe • vor 11 Monaten

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.

Allie K. Miller

80,345 Aufrufe • vor 11 Monaten

OPENAI 🔥: The built-in web browser in the ChatGPT app is becoming more mature. Now it supports URL suggestions during typing. Besides that, the ChatGPT Chrome extension can now reference open tabs, highlight to ask, and more! I may need to try it as a default 👀

OPENAI 🔥: The built-in web browser in the ChatGPT app is becoming more mature. Now it supports URL suggestions during typing. Besides that, the ChatGPT Chrome extension can now reference open tabs, highlight to ask, and more! I may need to try it as a default 👀

🚨 AI News | TestingCatalog

62,691 Aufrufe • vor 4 Tagen

i hate the way tool calling works today, so i built a fix for it its called `executor` and it lets your agent run code to call any API / MCP / GraphQL server rather than installing CLIs this is a soft launch, you can try it with npm i -g executor but im still making it great

i hate the way tool calling works today, so i built a fix for it its called `executor` and it lets your agent run code to call any API / MCP / GraphQL server rather than installing CLIs this is a soft launch, you can try it with npm i -g executor but im still making it great

Rhys

129,065 Aufrufe • vor 4 Monaten

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

3,741,838 Aufrufe • vor 2 Jahren

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

3,069,494 Aufrufe • vor 2 Jahren

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

we've been disappointed at how the input into most apps is still just mouse and keyboard. So we built a tool that lets you write directly into any app - check it out

WillScuderi

5,826,968 Aufrufe • vor 2 Jahren

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

you don’t need a robot to see physical ai in action, you just need a browser. this week I finally tried something I've wanted to do for a while: design an SO-101 scene in three.js, connect it to a real leader arm, collect teleoperation data, train an ACT model, then port it to run in the browser. the result is the first ever demo of ACT that runs locally on the web. try it yourself now at

Binh Pham

120,916 Aufrufe • vor 1 Monat

Day 13 Update - Aida the browser AI assistant. Aida can now think and execute plans - watch it scrape the current tab for all video titles on Rahul Mathur's Breakdown channel and save it as a txt file. Note that none of this code is written in advance or just a tool call, it writes code in realtime and dynamically executes it in the context of the browser. - Worked on the DOM Engine which provides better context to the assistant for dynamic code execution. - Wasn't satisfied with the design in the last update, tried to make it better. Whats next? Getting it to the hands of users. I've been gate-keeping this for too long. Made an accountability bet with Yogini Bende today to release it in a day.

Day 13 Update - Aida the browser AI assistant. Aida can now think and execute plans - watch it scrape the current tab for all video titles on Rahul Mathur's Breakdown channel and save it as a txt file. Note that none of this code is written in advance or just a tool call, it writes code in realtime and dynamically executes it in the context of the browser. - Worked on the DOM Engine which provides better context to the assistant for dynamic code execution. - Wasn't satisfied with the design in the last update, tried to make it better. Whats next? Getting it to the hands of users. I've been gate-keeping this for too long. Made an accountability bet with Yogini Bende today to release it in a day.

Nakshatra Saxena

10,971 Aufrufe • vor 1 Jahr