Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No...

405,205 Aufrufe • vor 4 Monaten •via X (Twitter)

58 Kommentare

Profilbild von am.will
am.willvor 4 Monaten

thanks for sharing james! so to confirm, the integrated browser is NOT live yet right?

Profilbild von James Sun
James Sunvor 4 Monaten

Sorry it's hard to find right now! We'll be giving Codex the ability to drive the browser autonomously soon, so it will be much easier to discover :)

Profilbild von Andrew Mayne
Andrew Maynevor 4 Monaten

Any advice on getting Codex to trigger it? It still wants to use the Playwright tool even when the browser tab is open.

Profilbild von James Sun
James Sunvor 4 Monaten

We haven't plugged in the browser-use agent yet, so the only agent workflow that Codex knows for the browser is iterating based on your comments! We'll ship an update next week that lets Codex fully drive the browser.

Profilbild von Andrew Mayne
Andrew Maynevor 4 Monaten

Thanks! Just having a built in browser is great! It really makes it the everything app.

Profilbild von Stephen Turner 🇬🇧🇺🇦
Stephen Turner 🇬🇧🇺🇦vor 4 Monaten

Profilbild von James Sun
James Sunvor 4 Monaten

It's on Windows!

Profilbild von Chrys Johnson
Chrys Johnsonvor 4 Monaten

@LittleBrainz Definitely isn't. The app itself is but the new capabilities arent

Profilbild von James Sun
James Sunvor 4 Monaten

@LittleBrainz looking into this now

Profilbild von James Sun
James Sunvor 4 Monaten

@LittleBrainz should be available, can you try updating?

Profilbild von James Sun
James Sunvor 4 Monaten

@LittleBrainz If not, can you give me your specs and the version number of your Codex?

Profilbild von ່
vor 4 Monaten

You guys should just make gpt5.4 good at frontend. This would be bomb!

Profilbild von James Sun
James Sunvor 4 Monaten

we've got something cooking for you

Profilbild von ່
vor 4 Monaten

🥹

Profilbild von beeman 📱
beeman 📱vor 4 Monaten

@ajambrosino Amazing! Does it work like a regular browser when it comes to cookies etc? A lot of apps that I'm building need auth so they have to be logged in - this is often a hassle with playwright sessions, it never figures it out

Profilbild von James Sun
James Sunvor 4 Monaten

@ajambrosino Hey! You should be able to auth provided there is email + password flow. The browser today is a bit limited because it doesn't support a few things like multiple tabs, web permissions, etc. We are incrementally bringing the full capabilities of a browser into this product!

Profilbild von Kierre Reeg
Kierre Reegvor 4 Monaten

Hello, so on the Codex mac app, the file tree browser needs a splitter so you can drag it so its wider on the horizontal axis. If you have deep file trees or long file names this view is much too constricted and it hurts usability.

Profilbild von James Sun
James Sunvor 4 Monaten

thanks for the feedback, passing it to the team!

Profilbild von Kierre Reeg
Kierre Reegvor 4 Monaten

The other thing is for the excel file viewer, we need dark mode, its way too bright with all that white

Profilbild von Yaya Soumah
Yaya Soumahvor 4 Monaten

@jxnlco I can’t make codex spin up the browser, and for computer use I see a message relayed to the fact that I don’t have a plugin. I’m confused

Profilbild von James Sun
James Sunvor 4 Monaten

@jxnlco sorry about that! We are hooking up the agent with the browser next week, so you'll have to click on a localhost or local file link to open up the browser. For computer use, click settings, computer use and install the plugin :)

Profilbild von Yaya Soumah
Yaya Soumahvor 4 Monaten

@jxnlco Here

Profilbild von James Sun
James Sunvor 4 Monaten

@jxnlco Trying to see if this is because of EU. Are you based in Europe?

Profilbild von Yaya Soumah
Yaya Soumahvor 4 Monaten

@jxnlco Yes, sorry, I read later that is not available in EU? Don’t understand why, Anthropic do released in EU too

Profilbild von That Teck Guy
That Teck Guyvor 4 Monaten

i dont see computer use or any updates and im not in the EU @JamesZmSun

Profilbild von Brad H
Brad Hvor 4 Monaten

This feature is fantastic! I can't express it enough much this will help my workflow. THANK YOU!

Profilbild von Andrey
Andreyvor 4 Monaten

@DamiDina do agents really need visuals though?

Profilbild von NigerianVoice
NigerianVoicevor 4 Monaten

This is one of those small-feeling features that quietly changes how you build. Turning the browser into structured context (DOM + screenshot + intent) removes so much friction between “seeing” and “fixing.” Feels less like prompting and more like pair programming with the web itself.

Profilbild von dnu
dnuvor 4 Monaten

in-app browser is the right primitive. the failure mode i kept hitting was agents losing the exact page state after a refresh and then repeating bad clicks. are you persisting page context per task or mostly relying on screenshot history?

Profilbild von James Sun
James Sunvor 4 Monaten

we don't pass the page context to the agent yet. We have some safety work that we are doing this week to prevent against prompt injection, etc. Right now, the agent can only see screenshots if you comment, and the page title!

Profilbild von Reda Salmi
Reda Salmivor 4 Monaten

waiting for linux support 👀

Profilbild von Joe Devon
Joe Devonvor 4 Monaten

My Macbook Pro with 16GB ram was already struggling w/ my AI use, I don't think I can try this out reliably, but I am very impressed with what you've done here and will eagerly try it when upgrading to a new Mac w/ Ram maxed out this time.

Profilbild von Gabe
Gabevor 4 Monaten

Does this browser trigger an anti-crawler mechanism? For example, log in to reddit and leave a comment

Profilbild von Udit
Uditvor 4 Monaten

Can't use in app browser in windows codex app

Profilbild von James Sun
James Sunvor 4 Monaten

can you try updating? if it's not working, can you give me your version number & spec?

Profilbild von Udit
Uditvor 4 Monaten

Reinstalling it did work for me, thanks

Profilbild von Yash
Yashvor 4 Monaten

How to use it?

Profilbild von James Sun
James Sunvor 4 Monaten

If you open a localhost or local file link in Codex, it will open the browser! Otherwise, you can also use Cmd + Shift + B to open it up directly

Profilbild von Nick Woodhead | GPTree | Foremerge | TranslateTech
Nick Woodhead | GPTree | Foremerge | TranslateTechvor 4 Monaten

Point and click productivity just leveled up!

Profilbild von Adi Patel
Adi Patelvor 4 Monaten

thats pretty cool, gives me a reason to get back on codex

Profilbild von zenyP
zenyPvor 4 Monaten

@sama Fucking yes, I knew you were doing something on UI

Profilbild von MysterE
MysterEvor 4 Monaten

Does it still suck at front end design? Nobody wants ugly web pages

Profilbild von DigitalAssetBuzz 🔶
DigitalAssetBuzz 🔶vor 4 Monaten

This looks genuinely useful. Real question though — how does this compare to what Claude Opus 4.7 is doing with its vision upgrade? They just shipped 3x image resolution and 98.5% visual acuity for computer use. Different approach but same problem: get the AI to actually see what you're seeing. What's Codex doing here that Opus can't?

Profilbild von Abhishek K Singh
Abhishek K Singhvor 4 Monaten

This is great! Can you all do something like this for markdowns/plans? It’d be great if one could review those almost like word/google docs and leave comments / annotations for the agent to address and then see/manage updates in a single spec/plan file.

Profilbild von rondd
ronddvor 4 Monaten

wow

Profilbild von Владислав Колесников
Владислав Колесниковvor 4 Monaten

Good job, respect

Profilbild von Kevin Guaman
Kevin Guamanvor 4 Monaten

Awesome. Less screenshots will be taken

Profilbild von Chetan | 3D Websites Daily
Chetan | 3D Websites Dailyvor 4 Monaten

@soumitrashukla9 wow this changes everything - finally i can point it to and make it update its own website lol :p

Profilbild von AstraCore
AstraCorevor 4 Monaten

Interesting! Does the DOM capture use something like a headless browser to get the full, post-JS-rendered state, or is it more of a static snapshot? Also, how does it handle dynamic SPAs where the DOM mutates frequently?

Profilbild von Senex
Senexvor 4 Monaten

Tried it out and.. not having full agent integration makes this rough. "No more switching between browsers or dragging screenshots" I.. already dont' have to do this with playwright, and not only that, the agent can actually see my screen. Hopefully we can get real benefits soon

Profilbild von David Pilcher
David Pilchervor 4 Monaten

@sama Can I use it to browse a project website, capture screenshots and put together an initial user manual structure?

Profilbild von James Sun
James Sunvor 4 Monaten

@sama Yep! You can use it on remote websites as well :)

Profilbild von David Pilcher
David Pilchervor 4 Monaten

@sama Great. Will give it a test!

Profilbild von Kingsley Uyi Idehen
Kingsley Uyi Idehenvor 4 Monaten

Here’s my variant of the Codex demo, as I didn’t quite grasp what was happening in the initial screencast. In my demo, I ask about the Virtuoso home page using its URL, then use the sidebar (very important) to open the built-in HTML browser. Once that’s in place, I’m able to perform operations such as deriving page descriptions in various structured data formats (JSON-LD, RDF-Turtle etc) for upload to my knowledge base. This knowledge base manifests as a Semantic Web, courtesy of Linked Data principles (i.e., naming entities and relationships using hyperlinks, and using those hyperlinks to construct RDF statements in subject–predicate–object, or entity–attribute–value form). Ultimately, this is just another step in the progression of knowledge base generation and management—supporting improved recall and reuse of data, information, and knowledge. From a modern business model perspective, in the age of AI, I also have the ability to monetize these knowledge bases using fine-grained, attribute-based access control (ABAC), where access is determined by evaluating attributes across the target knowledge base and the AI agents seeking access on behalf of human operations.

Profilbild von Chase Brignac 🚀
Chase Brignac 🚀vor 4 Monaten

@sama BROOOOOOOOOOOOOOOOOOO

Profilbild von Morgan
Morganvor 4 Monaten

This looks really cool James, looking forward to playing around with it!

Profilbild von Katz
Katzvor 4 Monaten

@ajambrosino Let’s goooo

Profilbild von frandev 🇦🇷
frandev 🇦🇷vor 4 Monaten

Wow 🤯 this is really great

Ähnliche Videos

EVERYTHING YOU NEED TO KNOW ABOUT CHATGPT'S "LOVABLE KILLER" CODEX SITES (in 25 mins): TLDR; the coolest part is that apps you build can update themselves autonomously 1. Codex Sites is not Replit or Lovable or Bolt. Those are great for one-prompting a full app. Codex Sites is for building apps that the agent keeps improving without you touching them. 2. Your personal website can update its own stats. Your internal dashboard can refresh its own data. Your product can add features while you sleep. The app is alive. 3. Start by invoking at-sites. Use realistic sample data. Always say "save for review, do not deploy." This unlocks building a real product, not a homepage. 4. Add persistent storage so the app remembers everything between visits. Without this it resets every time. Ask Codex to show you the data model before it builds. 5. Create safe actions. These are the specific things the agent is allowed to do to your app: add data, update cards, move things, score things. You define the boundaries. The agent operates within them. 6. Build skills so any future Codex chat knows how to interact with your app. The skill is basically a manual for the agent. Without it, every new chat starts from zero. 7. Save gate like a video game. Codex doesn't auto-save. Create checkpoints before you deploy so you can roll back if something breaks. 8. Close the autonomous loop. This is the magic. Once memory, safe actions, and skills are set up, the agent can update your app from any chat, any context, without you switching tabs. 9. Use the plugins most people are sleeping on. Figma, Canva, HeyGen for avatar videos, Game Studio for interactive experiences, FAL for image generation, Hugging Face for open source models. Worth adding a few. 10. The big picture: we went from building apps to raising apps. You set up the structure, the guardrails, and the skills. The agent does the rest. That's autonomous product building and it's here right now. Tbh, Codex sites isn't perfect. Still a lot to be desired like domains, db, authentication etc. But it's a glimpse into this idea that apps can be updated/improved upon automonously. And Codex Sites is REALLY good if you live in Codex everyday. Which more and more of are. And that's really cool. Will be interesting to see how Lovable, Bolt, Replit etc react to this. full tutorial on The Startup Ideas Podcast (SIP) 🧃 where you get your pods watch share with a friend i'm rooting for you What do you think of Codex and Codex sites?

GREG ISENBERG

69,219 Aufrufe • vor 3 Monaten