正在加载视频...

视频加载失败

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No...

405,205 次观看 • 4 个月前 •via X (Twitter)

58 条评论

am.will 的头像
am.will4 个月前

thanks for sharing james! so to confirm, the integrated browser is NOT live yet right?

James Sun 的头像
James Sun4 个月前

Sorry it's hard to find right now! We'll be giving Codex the ability to drive the browser autonomously soon, so it will be much easier to discover :)

Andrew Mayne 的头像
Andrew Mayne4 个月前

Any advice on getting Codex to trigger it? It still wants to use the Playwright tool even when the browser tab is open.

James Sun 的头像
James Sun4 个月前

We haven't plugged in the browser-use agent yet, so the only agent workflow that Codex knows for the browser is iterating based on your comments! We'll ship an update next week that lets Codex fully drive the browser.

Andrew Mayne 的头像
Andrew Mayne4 个月前

Thanks! Just having a built in browser is great! It really makes it the everything app.

Stephen Turner 🇬🇧🇺🇦 的头像
Stephen Turner 🇬🇧🇺🇦4 个月前

James Sun 的头像
James Sun4 个月前

It's on Windows!

Chrys Johnson 的头像
Chrys Johnson4 个月前

@LittleBrainz Definitely isn't. The app itself is but the new capabilities arent

James Sun 的头像
James Sun4 个月前

@LittleBrainz looking into this now

James Sun 的头像
James Sun4 个月前

@LittleBrainz should be available, can you try updating?

James Sun 的头像
James Sun4 个月前

@LittleBrainz If not, can you give me your specs and the version number of your Codex?

່ 的头像
4 个月前

You guys should just make gpt5.4 good at frontend. This would be bomb!

James Sun 的头像
James Sun4 个月前

we've got something cooking for you

່ 的头像
4 个月前

🥹

beeman 📱 的头像
beeman 📱4 个月前

@ajambrosino Amazing! Does it work like a regular browser when it comes to cookies etc? A lot of apps that I'm building need auth so they have to be logged in - this is often a hassle with playwright sessions, it never figures it out

James Sun 的头像
James Sun4 个月前

@ajambrosino Hey! You should be able to auth provided there is email + password flow. The browser today is a bit limited because it doesn't support a few things like multiple tabs, web permissions, etc. We are incrementally bringing the full capabilities of a browser into this product!

Kierre Reeg 的头像
Kierre Reeg4 个月前

Hello, so on the Codex mac app, the file tree browser needs a splitter so you can drag it so its wider on the horizontal axis. If you have deep file trees or long file names this view is much too constricted and it hurts usability.

James Sun 的头像
James Sun4 个月前

thanks for the feedback, passing it to the team!

Kierre Reeg 的头像
Kierre Reeg4 个月前

The other thing is for the excel file viewer, we need dark mode, its way too bright with all that white

Yaya Soumah 的头像
Yaya Soumah4 个月前

@jxnlco I can’t make codex spin up the browser, and for computer use I see a message relayed to the fact that I don’t have a plugin. I’m confused

James Sun 的头像
James Sun4 个月前

@jxnlco sorry about that! We are hooking up the agent with the browser next week, so you'll have to click on a localhost or local file link to open up the browser. For computer use, click settings, computer use and install the plugin :)

Yaya Soumah 的头像
Yaya Soumah4 个月前

@jxnlco Here

James Sun 的头像
James Sun4 个月前

@jxnlco Trying to see if this is because of EU. Are you based in Europe?

Yaya Soumah 的头像
Yaya Soumah4 个月前

@jxnlco Yes, sorry, I read later that is not available in EU? Don’t understand why, Anthropic do released in EU too

That Teck Guy 的头像
That Teck Guy4 个月前

i dont see computer use or any updates and im not in the EU @JamesZmSun

Brad H 的头像
Brad H4 个月前

This feature is fantastic! I can't express it enough much this will help my workflow. THANK YOU!

Andrey 的头像
Andrey4 个月前

@DamiDina do agents really need visuals though?

NigerianVoice 的头像
NigerianVoice4 个月前

This is one of those small-feeling features that quietly changes how you build. Turning the browser into structured context (DOM + screenshot + intent) removes so much friction between “seeing” and “fixing.” Feels less like prompting and more like pair programming with the web itself.

dnu 的头像
dnu4 个月前

in-app browser is the right primitive. the failure mode i kept hitting was agents losing the exact page state after a refresh and then repeating bad clicks. are you persisting page context per task or mostly relying on screenshot history?

James Sun 的头像
James Sun4 个月前

we don't pass the page context to the agent yet. We have some safety work that we are doing this week to prevent against prompt injection, etc. Right now, the agent can only see screenshots if you comment, and the page title!

Reda Salmi 的头像
Reda Salmi4 个月前

waiting for linux support 👀

Joe Devon 的头像
Joe Devon4 个月前

My Macbook Pro with 16GB ram was already struggling w/ my AI use, I don't think I can try this out reliably, but I am very impressed with what you've done here and will eagerly try it when upgrading to a new Mac w/ Ram maxed out this time.

Gabe 的头像
Gabe4 个月前

Does this browser trigger an anti-crawler mechanism? For example, log in to reddit and leave a comment

Udit 的头像
Udit4 个月前

Can't use in app browser in windows codex app

James Sun 的头像
James Sun4 个月前

can you try updating? if it's not working, can you give me your version number & spec?

Udit 的头像
Udit4 个月前

Reinstalling it did work for me, thanks

Yash 的头像
Yash4 个月前

How to use it?

James Sun 的头像
James Sun4 个月前

If you open a localhost or local file link in Codex, it will open the browser! Otherwise, you can also use Cmd + Shift + B to open it up directly

Nick Woodhead | GPTree | Foremerge | TranslateTech 的头像
Nick Woodhead | GPTree | Foremerge | TranslateTech4 个月前

Point and click productivity just leveled up!

Adi Patel 的头像
Adi Patel4 个月前

thats pretty cool, gives me a reason to get back on codex

zenyP 的头像
zenyP4 个月前

@sama Fucking yes, I knew you were doing something on UI

MysterE 的头像
MysterE4 个月前

Does it still suck at front end design? Nobody wants ugly web pages

DigitalAssetBuzz 🔶 的头像
DigitalAssetBuzz 🔶4 个月前

This looks genuinely useful. Real question though — how does this compare to what Claude Opus 4.7 is doing with its vision upgrade? They just shipped 3x image resolution and 98.5% visual acuity for computer use. Different approach but same problem: get the AI to actually see what you're seeing. What's Codex doing here that Opus can't?

Abhishek K Singh 的头像
Abhishek K Singh4 个月前

This is great! Can you all do something like this for markdowns/plans? It’d be great if one could review those almost like word/google docs and leave comments / annotations for the agent to address and then see/manage updates in a single spec/plan file.

rondd 的头像
rondd4 个月前

wow

Владислав Колесников 的头像
Владислав Колесников4 个月前

Good job, respect

Kevin Guaman 的头像
Kevin Guaman4 个月前

Awesome. Less screenshots will be taken

Chetan | 3D Websites Daily 的头像
Chetan | 3D Websites Daily4 个月前

@soumitrashukla9 wow this changes everything - finally i can point it to and make it update its own website lol :p

AstraCore 的头像
AstraCore4 个月前

Interesting! Does the DOM capture use something like a headless browser to get the full, post-JS-rendered state, or is it more of a static snapshot? Also, how does it handle dynamic SPAs where the DOM mutates frequently?

Senex 的头像
Senex4 个月前

Tried it out and.. not having full agent integration makes this rough. "No more switching between browsers or dragging screenshots" I.. already dont' have to do this with playwright, and not only that, the agent can actually see my screen. Hopefully we can get real benefits soon

David Pilcher 的头像
David Pilcher4 个月前

@sama Can I use it to browse a project website, capture screenshots and put together an initial user manual structure?

James Sun 的头像
James Sun4 个月前

@sama Yep! You can use it on remote websites as well :)

David Pilcher 的头像
David Pilcher4 个月前

@sama Great. Will give it a test!

Kingsley Uyi Idehen 的头像
Kingsley Uyi Idehen4 个月前

Here’s my variant of the Codex demo, as I didn’t quite grasp what was happening in the initial screencast. In my demo, I ask about the Virtuoso home page using its URL, then use the sidebar (very important) to open the built-in HTML browser. Once that’s in place, I’m able to perform operations such as deriving page descriptions in various structured data formats (JSON-LD, RDF-Turtle etc) for upload to my knowledge base. This knowledge base manifests as a Semantic Web, courtesy of Linked Data principles (i.e., naming entities and relationships using hyperlinks, and using those hyperlinks to construct RDF statements in subject–predicate–object, or entity–attribute–value form). Ultimately, this is just another step in the progression of knowledge base generation and management—supporting improved recall and reuse of data, information, and knowledge. From a modern business model perspective, in the age of AI, I also have the ability to monetize these knowledge bases using fine-grained, attribute-based access control (ABAC), where access is determined by evaluating attributes across the target knowledge base and the AI agents seeking access on behalf of human operations.

Chase Brignac 🚀 的头像
Chase Brignac 🚀4 个月前

@sama BROOOOOOOOOOOOOOOOOOO

Morgan 的头像
Morgan4 个月前

This looks really cool James, looking forward to playing around with it!

Katz 的头像
Katz4 个月前

@ajambrosino Let’s goooo

frandev 🇦🇷 的头像
frandev 🇦🇷4 个月前

Wow 🤯 this is really great

相关视频

EVERYTHING YOU NEED TO KNOW ABOUT CHATGPT'S "LOVABLE KILLER" CODEX SITES (in 25 mins): TLDR; the coolest part is that apps you build can update themselves autonomously 1. Codex Sites is not Replit or Lovable or Bolt. Those are great for one-prompting a full app. Codex Sites is for building apps that the agent keeps improving without you touching them. 2. Your personal website can update its own stats. Your internal dashboard can refresh its own data. Your product can add features while you sleep. The app is alive. 3. Start by invoking at-sites. Use realistic sample data. Always say "save for review, do not deploy." This unlocks building a real product, not a homepage. 4. Add persistent storage so the app remembers everything between visits. Without this it resets every time. Ask Codex to show you the data model before it builds. 5. Create safe actions. These are the specific things the agent is allowed to do to your app: add data, update cards, move things, score things. You define the boundaries. The agent operates within them. 6. Build skills so any future Codex chat knows how to interact with your app. The skill is basically a manual for the agent. Without it, every new chat starts from zero. 7. Save gate like a video game. Codex doesn't auto-save. Create checkpoints before you deploy so you can roll back if something breaks. 8. Close the autonomous loop. This is the magic. Once memory, safe actions, and skills are set up, the agent can update your app from any chat, any context, without you switching tabs. 9. Use the plugins most people are sleeping on. Figma, Canva, HeyGen for avatar videos, Game Studio for interactive experiences, FAL for image generation, Hugging Face for open source models. Worth adding a few. 10. The big picture: we went from building apps to raising apps. You set up the structure, the guardrails, and the skills. The agent does the rest. That's autonomous product building and it's here right now. Tbh, Codex sites isn't perfect. Still a lot to be desired like domains, db, authentication etc. But it's a glimpse into this idea that apps can be updated/improved upon automonously. And Codex Sites is REALLY good if you live in Codex everyday. Which more and more of are. And that's really cool. Will be interesting to see how Lovable, Bolt, Replit etc react to this. full tutorial on The Startup Ideas Podcast (SIP) 🧃 where you get your pods watch share with a friend i'm rooting for you What do you think of Codex and Codex sites?

GREG ISENBERG

69,219 次观看 • 3 个月前