Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Voice mode in Comet uses OpenAI Developers’s new gpt-realtime-1.5. With this upgrade we were able to optimize tool call stability by over 25%, and dramatically improve voice expressiveness.

comet's profile picture

Comet

44,087 subscribers

54,767 Aufrufe • vor 6 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo
1:46

Voice workflows just got stronger with gpt-realtime-1.5 in the Realtime API. The model offers more reliable instruction following, tool calling, and multilingual accuracy. Demo with Charlie Guo

OpenAI Developers

418,118 Aufrufe • vor 6 Monaten

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)
3:13

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 Aufrufe • vor 3 Monaten

the new OpenAI realtime voice model just released + gpt 5.5 fast mode brings us a new possibility - realtime speech to live presentation! i just talk, and the whiteboard would whiteboard itself prototype is open sourced. details in thread below -
1:46

the new OpenAI realtime voice model just released + gpt 5.5 fast mode brings us a new possibility - realtime speech to live presentation! i just talk, and the whiteboard would whiteboard itself prototype is open sourced. details in thread below -

Kun Chen

114,908 Aufrufe • vor 3 Monaten

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.
4:03

Introducing GPT-Realtime-2 in the API: our most intelligent voice model yet, bringing GPT-5-class reasoning to voice agents. Voice agents are now real-time collaborators that can listen, reason, and solve complex problems as conversations unfold. Now available in the API alongside streaming models GPT-Realtime-Translate and GPT-Realtime-Whisper — a new set of audio capabilities for the next generation of voice interfaces.

OpenAI

3,662,973 Aufrufe • vor 3 Monaten

OPENAI 🔥: New voice samples and orbs for an upcoming ChatGPT voice mode upgrade. Orb color is bound to an accent color you choose in settings. * Not available yet
0:47

OPENAI 🔥: New voice samples and orbs for an upcoming ChatGPT voice mode upgrade. Orb color is bound to an accent color you choose in settings. * Not available yet

🚨 AI News | TestingCatalog

67,428 Aufrufe • vor 1 Monat

We are getting closer to “Her” (part 2!) Conversationally do anything with emails, using LLM chaining & few-shot prompting for tool use ( inspired) This is now realtime (ish), thanks to #OpenAI gpt-3.5-turbo 🔈 on for voice realism! 🧵
1:26

We are getting closer to “Her” (part 2!) Conversationally do anything with emails, using LLM chaining & few-shot prompting for tool use ( inspired) This is now realtime (ish), thanks to #OpenAI gpt-3.5-turbo 🔈 on for voice realism! 🧵

Justin Alvey

481,156 Aufrufe • vor 3 Jahren

OPENAI 🔥: A Realtime Voice Mode on Codex will trigger a Pet or an Orb to appear! > Users will be able to invoke them with the "Hey Chat" command. > The Orb mentioned in the Realtime Voice settings is likely the same Orb we see on ChatGPT today. > Additionally, Codex will get a Library section in the side nav, the same section we see on ChatGPT. Codex = ChatGPT soon 👀 * The video shows that Pet has been summoned via the Voice Mode button.
0:33

OPENAI 🔥: A Realtime Voice Mode on Codex will trigger a Pet or an Orb to appear! > Users will be able to invoke them with the "Hey Chat" command. > The Orb mentioned in the Realtime Voice settings is likely the same Orb we see on ChatGPT today. > Additionally, Codex will get a Library section in the side nav, the same section we see on ChatGPT. Codex = ChatGPT soon 👀 * The video shows that Pet has been summoned via the Voice Mode button.

🚨 AI News | TestingCatalog

68,831 Aufrufe • vor 2 Monaten

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.
1:20

Voice is an interface, and I feel we’re going to see voice explode. OpenAI gpt-realtime is out and allows for native speech-to-speech and precise tool calling in real time. It can also take image inputs and place SIP phone calls - good for a quick triage before human handoff.

Allie K. Miller

80,345 Aufrufe • vor 1 Jahr

Build voice agents that do real work. We built a clinic concierge demo for a Singapore health clinic with gpt-realtime-1.5. It speaks naturally with patients, collects the right details, and books appointments in real time.
2:04

Build voice agents that do real work. We built a clinic concierge demo for a Singapore health clinic with gpt-realtime-1.5. It speaks naturally with patients, collects the right details, and books appointments in real time.

OpenAI Developers

168,564 Aufrufe • vor 5 Monaten

Voice-only programming with the new OpenAI Realtime API ... I spend a lot of time these days pair programming with LLMs. Often I'm talking rather than typing. This "voice dictation" use case has become an important vibe benchmark for me. Being able to create text input just by talking, flexibly, in a context dependent way, with tool calling, is a *hard* problem for today's models. Natural language dictation requires a very high degree of contextual intelligence, instruction following accuracy, and tool calling reliability. Today's new gpt-realtime model is quite good at this hard problem. The original realtime model release last year was impressive. Seeing what a speech-to-speech model could do got a lot of people excited about the possibilities of voice AI. The improvements since that first release are equally impressive. I can use this new model, now, for real world tasks that were past the edge of the "jagged frontier" before. Here's a video showing a couple of fun (and tricky) modes of voice input.
2:40

Voice-only programming with the new OpenAI Realtime API ... I spend a lot of time these days pair programming with LLMs. Often I'm talking rather than typing. This "voice dictation" use case has become an important vibe benchmark for me. Being able to create text input just by talking, flexibly, in a context dependent way, with tool calling, is a *hard* problem for today's models. Natural language dictation requires a very high degree of contextual intelligence, instruction following accuracy, and tool calling reliability. Today's new gpt-realtime model is quite good at this hard problem. The original realtime model release last year was impressive. Seeing what a speech-to-speech model could do got a lot of people excited about the possibilities of voice AI. The improvements since that first release are equally impressive. I can use this new model, now, for real world tasks that were past the edge of the "jagged frontier" before. Here's a video showing a couple of fun (and tricky) modes of voice input.

kwindla

50,874 Aufrufe • vor 1 Jahr

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock
2:06

Over the past six months, we shipped 30+ models, features, and upgraded tools for the API. Our changelog has been busy. Here’s what you may have missed for the API: New models • GPT-5.5 • GPT-5.4 mini • GPT-5.4 nano • GPT-Realtime-2 • GPT-Realtime-Whisper • GPT-Realtime-Translate • GPT-Image-2 Agent building blocks • Agents SDK harness & sandbox • Skills in the Responses API • Server-side compaction • WebSocket mode • Hosted shell More ways to build • Admin API enhancements • OpenAI CLI • Models on Amazon Bedrock

OpenAI Developers

159,861 Aufrufe • vor 2 Monaten

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours
6:15

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours

jacob paris ▲

32,463 Aufrufe • vor 2 Monaten

Taking talking shop to a whole new level. We just shipped Glean’s real-time voice capability, powered by OpenAI’s newest speech model GPT-Realtime-2. Grounded in the context across your org, it feels like a real AI coworker and can keep up with how work gets finished. In internal evals, GPT-Realtime-2 delivered a 42.9% relative increase in helpfulness over its previous version. Give it a try. It speaks for itself. OpenAIDevs
1:55

Taking talking shop to a whole new level. We just shipped Glean’s real-time voice capability, powered by OpenAI’s newest speech model GPT-Realtime-2. Grounded in the context across your org, it feels like a real AI coworker and can keep up with how work gets finished. In internal evals, GPT-Realtime-2 delivered a 42.9% relative increase in helpfulness over its previous version. Give it a try. It speaks for itself. OpenAIDevs

Glean

16,588 Aufrufe • vor 3 Monaten

ANTHROPIC 🔥: Voice mode on Claude mobile apps is about to get an upgrade with 18 new supported languages! > Claude will be able to change language on the fly > All languages have 1-2 new voices > Voice Mode UI will get a new look > A new push-to-talk functionality will be added > It is powered by Claude Haiku 4.5, but still TTS Soon? 👀
1:26

ANTHROPIC 🔥: Voice mode on Claude mobile apps is about to get an upgrade with 18 new supported languages! > Claude will be able to change language on the fly > All languages have 1-2 new voices > Voice Mode UI will get a new look > A new push-to-talk functionality will be added > It is powered by Claude Haiku 4.5, but still TTS Soon? 👀

🚨 AI News | TestingCatalog

135,012 Aufrufe • vor 3 Monaten

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍
1:44

At OpenAI DevDay, we introduced the Realtime API with a demo of an interactive solar system you can navigate with your voice. A lot of you have asked how it was built, so we've open-sourced it—with a twist: this version uses our new WebRTC integration. Have fun exploring! 🌍

Katia Gil Guzman

316,627 Aufrufe • vor 1 Jahr

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!
0:28

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch codex app-server with realtime - connect a client to realtime through WebRTC voice connection - Codex app-server is also attached on the side - talk to realtime - realtime decides whether coding is needed, and responds back with events - Codex app-server takes these events and runs codex agent turns - codex writes code like your codex cli exp Keep in mind OpenAI hasn't released this officially, they're still actively working on it, I just created a fork. This is a completely new UX than the usual chat interface for agentic coding. For example, when the agent responds back in voice, it's actually faster for me to read the response, and I don't actually find voice response that useful unless it does so in the background. But image realtime working in the background, you can talk to it, realtime keeps track of the different agents working on your tasks and your status. More to come on demo side, i'll make a more polished version and include voice, but thought this was cool to share. You can see in the responses the distinction between my voice input, realtime response, and realtime calling Codex to do work!

Matthew Lam

17,674 Aufrufe • vor 3 Monaten

We were really impressed with how fast OAI's new gpt-realtime-2.1 was while still being able to call tools, so we wired it into our OS agent running on my phone. Now I can completely control any app on my phone while I'm biking to work
2:24

We were really impressed with how fast OAI's new gpt-realtime-2.1 was while still being able to call tools, so we wired it into our OS agent running on my phone. Now I can completely control any app on my phone while I'm biking to work

Sam Hall

46,169 Aufrufe • vor 1 Monat

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.
1:22

Say hello to GPT-4o, our new flagship model which can reason across audio, vision, and text in real time: Text and image input rolling out today in API and ChatGPT with voice and video in the coming weeks.

OpenAI

22,824,262 Aufrufe • vor 2 Jahren