Loading video...

Video Failed to Load

Go Home

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No...

405,205 views • 4 months ago •via X (Twitter)

58 Comments

am.will's profile picture
am.will4 months ago

thanks for sharing james! so to confirm, the integrated browser is NOT live yet right?

James Sun's profile picture
James Sun4 months ago

Sorry it's hard to find right now! We'll be giving Codex the ability to drive the browser autonomously soon, so it will be much easier to discover :)

Andrew Mayne's profile picture
Andrew Mayne4 months ago

Any advice on getting Codex to trigger it? It still wants to use the Playwright tool even when the browser tab is open.

James Sun's profile picture
James Sun4 months ago

We haven't plugged in the browser-use agent yet, so the only agent workflow that Codex knows for the browser is iterating based on your comments! We'll ship an update next week that lets Codex fully drive the browser.

Andrew Mayne's profile picture
Andrew Mayne4 months ago

Thanks! Just having a built in browser is great! It really makes it the everything app.

Stephen Turner 🇬🇧🇺🇦's profile picture
Stephen Turner 🇬🇧🇺🇦4 months ago

James Sun's profile picture
James Sun4 months ago

It's on Windows!

Chrys Johnson's profile picture
Chrys Johnson4 months ago

@LittleBrainz Definitely isn't. The app itself is but the new capabilities arent

James Sun's profile picture
James Sun4 months ago

@LittleBrainz looking into this now

James Sun's profile picture
James Sun4 months ago

@LittleBrainz should be available, can you try updating?

James Sun's profile picture
James Sun4 months ago

@LittleBrainz If not, can you give me your specs and the version number of your Codex?

່'s profile picture
4 months ago

You guys should just make gpt5.4 good at frontend. This would be bomb!

James Sun's profile picture
James Sun4 months ago

we've got something cooking for you

່'s profile picture
4 months ago

🥹

beeman 📱's profile picture
beeman 📱4 months ago

@ajambrosino Amazing! Does it work like a regular browser when it comes to cookies etc? A lot of apps that I'm building need auth so they have to be logged in - this is often a hassle with playwright sessions, it never figures it out

James Sun's profile picture
James Sun4 months ago

@ajambrosino Hey! You should be able to auth provided there is email + password flow. The browser today is a bit limited because it doesn't support a few things like multiple tabs, web permissions, etc. We are incrementally bringing the full capabilities of a browser into this product!

Kierre Reeg's profile picture
Kierre Reeg4 months ago

Hello, so on the Codex mac app, the file tree browser needs a splitter so you can drag it so its wider on the horizontal axis. If you have deep file trees or long file names this view is much too constricted and it hurts usability.

James Sun's profile picture
James Sun4 months ago

thanks for the feedback, passing it to the team!

Kierre Reeg's profile picture
Kierre Reeg4 months ago

The other thing is for the excel file viewer, we need dark mode, its way too bright with all that white

Yaya Soumah's profile picture
Yaya Soumah4 months ago

@jxnlco I can’t make codex spin up the browser, and for computer use I see a message relayed to the fact that I don’t have a plugin. I’m confused

James Sun's profile picture
James Sun4 months ago

@jxnlco sorry about that! We are hooking up the agent with the browser next week, so you'll have to click on a localhost or local file link to open up the browser. For computer use, click settings, computer use and install the plugin :)

Yaya Soumah's profile picture
Yaya Soumah4 months ago

@jxnlco Here

James Sun's profile picture
James Sun4 months ago

@jxnlco Trying to see if this is because of EU. Are you based in Europe?

Yaya Soumah's profile picture
Yaya Soumah4 months ago

@jxnlco Yes, sorry, I read later that is not available in EU? Don’t understand why, Anthropic do released in EU too

That Teck Guy's profile picture
That Teck Guy4 months ago

i dont see computer use or any updates and im not in the EU @JamesZmSun

Brad H's profile picture
Brad H4 months ago

This feature is fantastic! I can't express it enough much this will help my workflow. THANK YOU!

Andrey's profile picture
Andrey4 months ago

@DamiDina do agents really need visuals though?

NigerianVoice's profile picture
NigerianVoice4 months ago

This is one of those small-feeling features that quietly changes how you build. Turning the browser into structured context (DOM + screenshot + intent) removes so much friction between “seeing” and “fixing.” Feels less like prompting and more like pair programming with the web itself.

dnu's profile picture
dnu4 months ago

in-app browser is the right primitive. the failure mode i kept hitting was agents losing the exact page state after a refresh and then repeating bad clicks. are you persisting page context per task or mostly relying on screenshot history?

James Sun's profile picture
James Sun4 months ago

we don't pass the page context to the agent yet. We have some safety work that we are doing this week to prevent against prompt injection, etc. Right now, the agent can only see screenshots if you comment, and the page title!

Reda Salmi's profile picture
Reda Salmi4 months ago

waiting for linux support 👀

Joe Devon's profile picture
Joe Devon4 months ago

My Macbook Pro with 16GB ram was already struggling w/ my AI use, I don't think I can try this out reliably, but I am very impressed with what you've done here and will eagerly try it when upgrading to a new Mac w/ Ram maxed out this time.

Gabe's profile picture
Gabe4 months ago

Does this browser trigger an anti-crawler mechanism? For example, log in to reddit and leave a comment

Udit's profile picture
Udit4 months ago

Can't use in app browser in windows codex app

James Sun's profile picture
James Sun4 months ago

can you try updating? if it's not working, can you give me your version number & spec?

Udit's profile picture
Udit4 months ago

Reinstalling it did work for me, thanks

Yash's profile picture
Yash4 months ago

How to use it?

James Sun's profile picture
James Sun4 months ago

If you open a localhost or local file link in Codex, it will open the browser! Otherwise, you can also use Cmd + Shift + B to open it up directly

Nick Woodhead | GPTree | Foremerge | TranslateTech's profile picture
Nick Woodhead | GPTree | Foremerge | TranslateTech4 months ago

Point and click productivity just leveled up!

Adi Patel's profile picture
Adi Patel4 months ago

thats pretty cool, gives me a reason to get back on codex

zenyP's profile picture
zenyP4 months ago

@sama Fucking yes, I knew you were doing something on UI

MysterE's profile picture
MysterE4 months ago

Does it still suck at front end design? Nobody wants ugly web pages

DigitalAssetBuzz 🔶's profile picture
DigitalAssetBuzz 🔶4 months ago

This looks genuinely useful. Real question though — how does this compare to what Claude Opus 4.7 is doing with its vision upgrade? They just shipped 3x image resolution and 98.5% visual acuity for computer use. Different approach but same problem: get the AI to actually see what you're seeing. What's Codex doing here that Opus can't?

Abhishek K Singh's profile picture
Abhishek K Singh4 months ago

This is great! Can you all do something like this for markdowns/plans? It’d be great if one could review those almost like word/google docs and leave comments / annotations for the agent to address and then see/manage updates in a single spec/plan file.

rondd's profile picture
rondd4 months ago

wow

Владислав Колесников's profile picture
Владислав Колесников4 months ago

Good job, respect

Kevin Guaman's profile picture
Kevin Guaman4 months ago

Awesome. Less screenshots will be taken

Chetan | 3D Websites Daily's profile picture
Chetan | 3D Websites Daily4 months ago

@soumitrashukla9 wow this changes everything - finally i can point it to and make it update its own website lol :p

AstraCore's profile picture
AstraCore4 months ago

Interesting! Does the DOM capture use something like a headless browser to get the full, post-JS-rendered state, or is it more of a static snapshot? Also, how does it handle dynamic SPAs where the DOM mutates frequently?

Senex's profile picture
Senex4 months ago

Tried it out and.. not having full agent integration makes this rough. "No more switching between browsers or dragging screenshots" I.. already dont' have to do this with playwright, and not only that, the agent can actually see my screen. Hopefully we can get real benefits soon

David Pilcher's profile picture
David Pilcher4 months ago

@sama Can I use it to browse a project website, capture screenshots and put together an initial user manual structure?

James Sun's profile picture
James Sun4 months ago

@sama Yep! You can use it on remote websites as well :)

David Pilcher's profile picture
David Pilcher4 months ago

@sama Great. Will give it a test!

Kingsley Uyi Idehen's profile picture
Kingsley Uyi Idehen4 months ago

Here’s my variant of the Codex demo, as I didn’t quite grasp what was happening in the initial screencast. In my demo, I ask about the Virtuoso home page using its URL, then use the sidebar (very important) to open the built-in HTML browser. Once that’s in place, I’m able to perform operations such as deriving page descriptions in various structured data formats (JSON-LD, RDF-Turtle etc) for upload to my knowledge base. This knowledge base manifests as a Semantic Web, courtesy of Linked Data principles (i.e., naming entities and relationships using hyperlinks, and using those hyperlinks to construct RDF statements in subject–predicate–object, or entity–attribute–value form). Ultimately, this is just another step in the progression of knowledge base generation and management—supporting improved recall and reuse of data, information, and knowledge. From a modern business model perspective, in the age of AI, I also have the ability to monetize these knowledge bases using fine-grained, attribute-based access control (ABAC), where access is determined by evaluating attributes across the target knowledge base and the AI agents seeking access on behalf of human operations.

Chase Brignac 🚀's profile picture
Chase Brignac 🚀4 months ago

@sama BROOOOOOOOOOOOOOOOOOO

Morgan's profile picture
Morgan4 months ago

This looks really cool James, looking forward to playing around with it!

Katz's profile picture
Katz4 months ago

@ajambrosino Let’s goooo

frandev 🇦🇷's profile picture
frandev 🇦🇷4 months ago

Wow 🤯 this is really great

Related Videos

EVERYTHING YOU NEED TO KNOW ABOUT CHATGPT'S "LOVABLE KILLER" CODEX SITES (in 25 mins): TLDR; the coolest part is that apps you build can update themselves autonomously 1. Codex Sites is not Replit or Lovable or Bolt. Those are great for one-prompting a full app. Codex Sites is for building apps that the agent keeps improving without you touching them. 2. Your personal website can update its own stats. Your internal dashboard can refresh its own data. Your product can add features while you sleep. The app is alive. 3. Start by invoking at-sites. Use realistic sample data. Always say "save for review, do not deploy." This unlocks building a real product, not a homepage. 4. Add persistent storage so the app remembers everything between visits. Without this it resets every time. Ask Codex to show you the data model before it builds. 5. Create safe actions. These are the specific things the agent is allowed to do to your app: add data, update cards, move things, score things. You define the boundaries. The agent operates within them. 6. Build skills so any future Codex chat knows how to interact with your app. The skill is basically a manual for the agent. Without it, every new chat starts from zero. 7. Save gate like a video game. Codex doesn't auto-save. Create checkpoints before you deploy so you can roll back if something breaks. 8. Close the autonomous loop. This is the magic. Once memory, safe actions, and skills are set up, the agent can update your app from any chat, any context, without you switching tabs. 9. Use the plugins most people are sleeping on. Figma, Canva, HeyGen for avatar videos, Game Studio for interactive experiences, FAL for image generation, Hugging Face for open source models. Worth adding a few. 10. The big picture: we went from building apps to raising apps. You set up the structure, the guardrails, and the skills. The agent does the rest. That's autonomous product building and it's here right now. Tbh, Codex sites isn't perfect. Still a lot to be desired like domains, db, authentication etc. But it's a glimpse into this idea that apps can be updated/improved upon automonously. And Codex Sites is REALLY good if you live in Codex everyday. Which more and more of are. And that's really cool. Will be interesting to see how Lovable, Bolt, Replit etc react to this. full tutorial on The Startup Ideas Podcast (SIP) 🧃 where you get your pods watch share with a friend i'm rooting for you What do you think of Codex and Codex sites?

GREG ISENBERG

69,219 views • 3 months ago