Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

This is crazy, I can talk to OpenAI's realtime API, and it'll respond back with voice, and then help call Codex to help me code! Got curious about Codex and its realtime integration, and found codex's feature flag `realtime_conversation` integrated for the codex app-server. How it works: - launch...

mattlam_'s profile picture

Matthew Lam

3,036 subscribers

17,674 Aufrufe • vor 3 Monaten •via X (Twitter)

LIVE

Anya Rossi• Live Now

Private livecam show

0 Kommentare

Keine Kommentare verfügbar

Kommentare vom Original-Post werden hier angezeigt

Ähnliche Videos

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing
1:01

here is the first look at realtime voice mode in codex the ui is already in the app, but the codex backend endpoint does not seem to be live yet i got it running by forcing the local feature gate and using my own openai api key, so it goes through the public realtime api instead it's incredible, but this demo alone cost me ~$4 gpt realtime 2 is very expensive, which makes me wonder how they're going to handle it - part of the normal usage limit, or a separate limit like we had with gpt 5.3 codex spark? i'm turning it off until the official rollout but get excited, the next few weeks are going to be amazing

🥔🥔🥔

39,508 Aufrufe • vor 3 Monaten

ChatGPT Voice is now available on Desktop in Work and Codex! And your Codex Micro is already fully compatible with it. It's never been easier to talk to your computer, launch and manage Codex tasks, and basically do anything with Codex. A truly feel AGI moment to me.
0:42

ChatGPT Voice is now available on Desktop in Work and Codex! And your Codex Micro is already fully compatible with it. It's never been easier to talk to your computer, launch and manage Codex tasks, and basically do anything with Codex. A truly feel AGI moment to me.

Thomas Ricouard

20,192 Aufrufe • vor 1 Monat

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!
1:18

Built a "YouTube realtime copilot" browser extension using OpenAI's realtime 2 API: The agent watches the video alongside you, and can answer any question you have about what was just said via realtime voice chat. The crazy part to me is: It can differentiate the YouTube's audio stream and your voice, so it doesn't confuse the video as commands, and stays silent unless you ask something!

Zara Zhang

45,631 Aufrufe • vor 4 Monaten

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours
6:15

Today I built this voice agent while on a call with it Introducing /this-needs-a-call - it's a slash command to start a phone call - grill or be grilled by the voice agent in realtime - your coding agent listens in on the call via MCP and works while you talk for hours

jacob paris ▲

32,463 Aufrufe • vor 2 Monaten

I’ve got Codex (voice) in CarPlay. And it’s fantastic. I can now build things during road trips, while all 5 kids make a noise and my wife asks why I talk to the AI more than I talk to her. It runs through my Nightblood iOS app, which gives ChatGPT Voice a face, personality and full access to Codex, my Mac and all the native tools.
2:51

I’ve got Codex (voice) in CarPlay. And it’s fantastic. I can now build things during road trips, while all 5 kids make a noise and my wife asks why I talk to the AI more than I talk to her. It runs through my Nightblood iOS app, which gives ChatGPT Voice a face, personality and full access to Codex, my Mac and all the native tools.

Jonathan Roomer

375,326 Aufrufe • vor 5 Tagen

ok this is pretty dope. we basically have a realtime voice openclaw now that can just spawn codex app-servers on the network and command them theres a weird ui glitch that makes the whole thing super trippy, i kinda like it lol also, switching the themes randomly every 3 seconds for an extra psychedelic experience
0:41

ok this is pretty dope. we basically have a realtime voice openclaw now that can just spawn codex app-servers on the network and command them theres a weird ui glitch that makes the whole thing super trippy, i kinda like it lol also, switching the themes randomly every 3 seconds for an extra psychedelic experience

SIGKITTEN

20,555 Aufrufe • vor 6 Monaten

Three skills I use every day in Claude Code and Codex to solve my hardest problems: 1️⃣ /agent-watchdog When I have one agent like Codex working on a task and I don't fully trust it's going to do everything right, I'll open up another one like Claude Code and tell it to watchdog the Codex thread. You can copy the Codex deep link into Claude Code and it'll look at the prompt you sent, watch the Codex thread until it's done, then compare the Codex solution to how it was planning to solve it and automatically fix anything that Codex missed. It can also test the work of the other agent end-to-end. Similar to the idea of OpenRouter's new Fusion feature, I've definitely found that two models thinking through a problem and checking each other's work can be wildly more impactful than just one. 2️⃣ /plan-arbiter Similar ideas as /agent-watchdog - but with this one you have both make plans, compare plans, negotiate the differences, and make a final plan to execute. I find Claude Code is better at writing plans, but Codex is faster and cheaper to execute on them. Then I usually have Claude Code watchdog the Codex work and fix anything that was missed. 3️⃣ /read-the-damn-docs One thing that drives me crazy with coding agents is they're so reluctant to look up docs. They'll just guess and guess and guess at the right API surface for things, or the right solution to an integration of two things. Once I explicitly tell it to look up the docs, it says "Oh, I see the answer," and it fixes the problem. So I made the /read-the-damn-docs skill. Add it and your agents will know when and how to do efficient web searches to look up docs for the types of problems you really should look up docs for. All of these are totally open source over on my GitHub. If you try them, let me know your feedback. Will link to them below:
1:21

Three skills I use every day in Claude Code and Codex to solve my hardest problems: 1️⃣ /agent-watchdog When I have one agent like Codex working on a task and I don't fully trust it's going to do everything right, I'll open up another one like Claude Code and tell it to watchdog the Codex thread. You can copy the Codex deep link into Claude Code and it'll look at the prompt you sent, watch the Codex thread until it's done, then compare the Codex solution to how it was planning to solve it and automatically fix anything that Codex missed. It can also test the work of the other agent end-to-end. Similar to the idea of OpenRouter's new Fusion feature, I've definitely found that two models thinking through a problem and checking each other's work can be wildly more impactful than just one. 2️⃣ /plan-arbiter Similar ideas as /agent-watchdog - but with this one you have both make plans, compare plans, negotiate the differences, and make a final plan to execute. I find Claude Code is better at writing plans, but Codex is faster and cheaper to execute on them. Then I usually have Claude Code watchdog the Codex work and fix anything that was missed. 3️⃣ /read-the-damn-docs One thing that drives me crazy with coding agents is they're so reluctant to look up docs. They'll just guess and guess and guess at the right API surface for things, or the right solution to an integration of two things. Once I explicitly tell it to look up the docs, it says "Oh, I see the answer," and it fixes the problem. So I made the /read-the-damn-docs skill. Add it and your agents will know when and how to do efficient web searches to look up docs for the types of problems you really should look up docs for. All of these are totally open source over on my GitHub. If you try them, let me know your feedback. Will link to them below:

Steve (Builder.io)

43,089 Aufrufe • vor 2 Monaten

Create Google Slides in Codex without opening your browser, clicking buttons, and manually aligning figures. Plus, you (and your team) can view the progress in realtime. Codex isn't creating the deck locally, then uploading it. It's actually iteratively building it, checking it's work and polishing it. Imagine kicking-off hundreds of these decks over night, and polishing them the next morning (or en-route to the meeting haha). Wild.
0:22

Create Google Slides in Codex without opening your browser, clicking buttons, and manually aligning figures. Plus, you (and your team) can view the progress in realtime. Codex isn't creating the deck locally, then uploading it. It's actually iteratively building it, checking it's work and polishing it. Imagine kicking-off hundreds of these decks over night, and polishing them the next morning (or en-route to the meeting haha). Wild.

Gabriel Chua

94,919 Aufrufe • vor 4 Monaten

Introducing Lynk, a brand new way to interact with your favorite harnesses on the go. Compatible with OpenClaw, Hermes, Codex, and local edge models. Fully featured client allowing you to easily and quickly switch between your favorite agents. Lynk has been my absolute favorite way to kick off tasks on the go, completely replacing Telegram. Only available as a beta on Android at present, but iOS version is in development. Works via local network or Tailscale. Features: - Create and continue threads with your favorite harness - OpenClaw, Hermes, Codex, and local models - Android Phone control - Realtime voice agent - Speech-to-text transcription - Codex Pets + live notifications - Draw over screen quick access chat overlay - Open Source software Join the beta in the comments.
2:14

Introducing Lynk, a brand new way to interact with your favorite harnesses on the go. Compatible with OpenClaw, Hermes, Codex, and local edge models. Fully featured client allowing you to easily and quickly switch between your favorite agents. Lynk has been my absolute favorite way to kick off tasks on the go, completely replacing Telegram. Only available as a beta on Android at present, but iOS version is in development. Works via local network or Tailscale. Features: - Create and continue threads with your favorite harness - OpenClaw, Hermes, Codex, and local models - Android Phone control - Realtime voice agent - Speech-to-text transcription - Codex Pets + live notifications - Draw over screen quick access chat overlay - Open Source software Join the beta in the comments.

am.will

111,376 Aufrufe • vor 3 Monaten

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)
3:13

OpenAI shipped a new speech-to-speech model today: gpt-realtime-2 This is the first speech-to-speech model good enough to use in my voice agents that do "real work." Or real play, for that matter. Here's gpt-realtime-2 as the brain of the ship AI in Gradient Bang. The voice-to-voice response and tool calling times here are unedited, so you can see exactly what the interaction with the model is like in an agent with a very complex system instruction and frequent tool calls. (I did clip out the subagent task execution segments, after gpt-realtime-2 starts a subagent via a tool call. Subagents in this config used gpt-5.2 "medium" effort.)

kwindla

55,222 Aufrufe • vor 4 Monaten

Introducing Genspark Realtime Voice. I connected Genspark to my car and headed to work. With Genspark Realtime Voice, prepping for the day feels as easy as chatting. It can check my schedule, send emails and messages, look things up, and even make me a commute playlist. It can also help me get real work done — generate slides, run deep research, analyze data, and more. Just talk. Fully hands-free!
2:16

Introducing Genspark Realtime Voice. I connected Genspark to my car and headed to work. With Genspark Realtime Voice, prepping for the day feels as easy as chatting. It can check my schedule, send emails and messages, look things up, and even make me a commute playlist. It can also help me get real work done — generate slides, run deep research, analyze data, and more. Just talk. Fully hands-free!

Genspark

169,275 Aufrufe • vor 5 Monaten

🚨 OpenAI just launched Codex, a brand-new autonomous coding agent that can build features and fix bugs on its own. We’ve been using it Every 📧 for a few days, and I’m impressed. I invited Alexander Embiricos (ben davies), a member of the product staff responsible for Codex, to demo Codex and talk about it live on a special edition of AI & I: What Codex is and how it works Codex is designed to be used by senior engineers—it performs coding tasks like adding features or fixing bugs autonomously. It's built to allow you to start many sessions at once, so you can have multiple agents working in parallel. Codex is built to have "taste" OpenAI trained Codex to have the taste of a senior software engineer. It knows how big codebases work, how to write a good PR, and uses clean, minimal code. Why an “abundance mindset” is best for interacting with agents Codex is designed to allow users to delegate many tasks at once without getting caught up in the details. This lets you point an abundance of agents at a specific task like a difficult bug—it’s worth it even if only one of them succeeds. How OpenAI is thinking about agents Codex is one piece of a unified super-assistant OpenAI wants to eventually build—an agent that helps users easily get things done by selecting the right tools for them behind the scenes. OpenAI’s vision for the future of programming In the future developers will probably spend less time writing routine code and more time guiding agents, reviewing their work, and making strategy decisions. Programming will become more social, letting teams easily delegate multiple tasks at once, allowing people to focus on ideas and collaboration instead of routine coding. Watch below!
44:33

🚨 OpenAI just launched Codex, a brand-new autonomous coding agent that can build features and fix bugs on its own. We’ve been using it Every 📧 for a few days, and I’m impressed. I invited Alexander Embiricos (ben davies), a member of the product staff responsible for Codex, to demo Codex and talk about it live on a special edition of AI & I: What Codex is and how it works Codex is designed to be used by senior engineers—it performs coding tasks like adding features or fixing bugs autonomously. It's built to allow you to start many sessions at once, so you can have multiple agents working in parallel. Codex is built to have "taste" OpenAI trained Codex to have the taste of a senior software engineer. It knows how big codebases work, how to write a good PR, and uses clean, minimal code. Why an “abundance mindset” is best for interacting with agents Codex is designed to allow users to delegate many tasks at once without getting caught up in the details. This lets you point an abundance of agents at a specific task like a difficult bug—it’s worth it even if only one of them succeeds. How OpenAI is thinking about agents Codex is one piece of a unified super-assistant OpenAI wants to eventually build—an agent that helps users easily get things done by selecting the right tools for them behind the scenes. OpenAI’s vision for the future of programming In the future developers will probably spend less time writing routine code and more time guiding agents, reviewing their work, and making strategy decisions. Programming will become more social, letting teams easily delegate multiple tasks at once, allowing people to focus on ideas and collaboration instead of routine coding. Watch below!

Dan Shipper 📧

145,487 Aufrufe • vor 1 Jahr

Wow very easy to create a Codex Site with a Convex DB that your agent can write to. You can make a todo list app that is hosted on Codex Sites, then tell Codex to make a skill that allows the agent to WRITE/EDIT to that todo list db. And then in any chat you can add to your list. Here's example.
0:40

Wow very easy to create a Codex Site with a Convex DB that your agent can write to. You can make a todo list app that is hosted on Codex Sites, then tell Codex to make a skill that allows the agent to WRITE/EDIT to that todo list db. And then in any chat you can add to your list. Here's example.

Riley Brown

54,081 Aufrufe • vor 3 Monaten

Codex /goal With Hermes Agent is life-changing. I updated my Hermes agent skill to give Codex a goal on the fly using Telegram and track each one of those codex goals in a Kanban board. It has been really insane to see and track Codex execute goals in the wild.
0:32

Codex /goal With Hermes Agent is life-changing. I updated my Hermes agent skill to give Codex a goal on the fly using Telegram and track each one of those codex goals in a Kanban board. It has been really insane to see and track Codex execute goals in the wild.

Shubham Saboo

202,128 Aufrufe • vor 4 Monaten

Windows users, this one’s for you. Computer use now works on Windows, so Codex can take action on your Windows computer. And with Windows support for Codex in the ChatGPT mobile app, you can start, review, and steer tasks on the go while work continues on your Windows machine. An early experience, but we’re working on more ways to keep your work moving, wherever you are.
1:49

Windows users, this one’s for you. Computer use now works on Windows, so Codex can take action on your Windows computer. And with Windows support for Codex in the ChatGPT mobile app, you can start, review, and steer tasks on the go while work continues on your Windows machine. An early experience, but we’re working on more ways to keep your work moving, wherever you are.

OpenAI

1,408,684 Aufrufe • vor 3 Monaten

Voice is now available in your existing Codex threads. Talk through a PR with the agent that wrote it, debate the architecture, or work out what comes next. You can jump into voice whenever something needs a back-and-forth, then let the agent keep working once you’ve figured it out together.
0:43

Voice is now available in your existing Codex threads. Talk through a PR with the agent that wrote it, debate the architecture, or work out what comes next. You can jump into voice whenever something needs a back-and-forth, then let the agent keep working once you’ve figured it out together.

Guinness Chen

181,840 Aufrufe • vor 16 Tagen

you can use codex voice from your phone now, connecting to your computer from anywhere!! behr and i got to star in this new codex ad, showing how much you can get done while working out. btw, this is powered by the new gpt-live-1
0:33

you can use codex voice from your phone now, connecting to your computer from anywhere!! behr and i got to star in this new codex ad, showing how much you can get done while working out. btw, this is powered by the new gpt-live-1

thijs

284,331 Aufrufe • vor 3 Tagen

After creating Remodex: Codex remote control for iOS I decided to chill a bit by building a browser sidebar inside Theo - t3.gg 's T3 Code You can open it with Cmd+Shift+B This software is so easy to "manipulate" and build upon Congrats to all the guys that put the work in it because it is great I certainly will be building more things with it For this one I decided to switch from the Codex App to the Codex CLI too just to see how it works And boy it was so good
0:20

After creating Remodex: Codex remote control for iOS I decided to chill a bit by building a browser sidebar inside Theo - t3.gg 's T3 Code You can open it with Cmd+Shift+B This software is so easy to "manipulate" and build upon Congrats to all the guys that put the work in it because it is great I certainly will be building more things with it For this one I decided to switch from the Codex App to the Codex CLI too just to see how it works And boy it was so good

Emanuele Di Pietro

38,905 Aufrufe • vor 5 Monaten