Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No...

405,205 görüntüleme • 4 ay önce •via X (Twitter)

58 Yorum

am.will profil fotoğrafı
am.will4 ay önce

thanks for sharing james! so to confirm, the integrated browser is NOT live yet right?

James Sun profil fotoğrafı
James Sun4 ay önce

Sorry it's hard to find right now! We'll be giving Codex the ability to drive the browser autonomously soon, so it will be much easier to discover :)

Andrew Mayne profil fotoğrafı
Andrew Mayne4 ay önce

Any advice on getting Codex to trigger it? It still wants to use the Playwright tool even when the browser tab is open.

James Sun profil fotoğrafı
James Sun4 ay önce

We haven't plugged in the browser-use agent yet, so the only agent workflow that Codex knows for the browser is iterating based on your comments! We'll ship an update next week that lets Codex fully drive the browser.

Andrew Mayne profil fotoğrafı
Andrew Mayne4 ay önce

Thanks! Just having a built in browser is great! It really makes it the everything app.

Stephen Turner 🇬🇧🇺🇦 profil fotoğrafı
Stephen Turner 🇬🇧🇺🇦4 ay önce

James Sun profil fotoğrafı
James Sun4 ay önce

It's on Windows!

Chrys Johnson profil fotoğrafı
Chrys Johnson4 ay önce

@LittleBrainz Definitely isn't. The app itself is but the new capabilities arent

James Sun profil fotoğrafı
James Sun4 ay önce

@LittleBrainz looking into this now

James Sun profil fotoğrafı
James Sun4 ay önce

@LittleBrainz should be available, can you try updating?

James Sun profil fotoğrafı
James Sun4 ay önce

@LittleBrainz If not, can you give me your specs and the version number of your Codex?

່ profil fotoğrafı
4 ay önce

You guys should just make gpt5.4 good at frontend. This would be bomb!

James Sun profil fotoğrafı
James Sun4 ay önce

we've got something cooking for you

່ profil fotoğrafı
4 ay önce

🥹

beeman 📱 profil fotoğrafı
beeman 📱4 ay önce

@ajambrosino Amazing! Does it work like a regular browser when it comes to cookies etc? A lot of apps that I'm building need auth so they have to be logged in - this is often a hassle with playwright sessions, it never figures it out

James Sun profil fotoğrafı
James Sun4 ay önce

@ajambrosino Hey! You should be able to auth provided there is email + password flow. The browser today is a bit limited because it doesn't support a few things like multiple tabs, web permissions, etc. We are incrementally bringing the full capabilities of a browser into this product!

Kierre Reeg profil fotoğrafı
Kierre Reeg4 ay önce

Hello, so on the Codex mac app, the file tree browser needs a splitter so you can drag it so its wider on the horizontal axis. If you have deep file trees or long file names this view is much too constricted and it hurts usability.

James Sun profil fotoğrafı
James Sun4 ay önce

thanks for the feedback, passing it to the team!

Kierre Reeg profil fotoğrafı
Kierre Reeg4 ay önce

The other thing is for the excel file viewer, we need dark mode, its way too bright with all that white

Yaya Soumah profil fotoğrafı
Yaya Soumah4 ay önce

@jxnlco I can’t make codex spin up the browser, and for computer use I see a message relayed to the fact that I don’t have a plugin. I’m confused

James Sun profil fotoğrafı
James Sun4 ay önce

@jxnlco sorry about that! We are hooking up the agent with the browser next week, so you'll have to click on a localhost or local file link to open up the browser. For computer use, click settings, computer use and install the plugin :)

Yaya Soumah profil fotoğrafı
Yaya Soumah4 ay önce

@jxnlco Here

James Sun profil fotoğrafı
James Sun4 ay önce

@jxnlco Trying to see if this is because of EU. Are you based in Europe?

Yaya Soumah profil fotoğrafı
Yaya Soumah4 ay önce

@jxnlco Yes, sorry, I read later that is not available in EU? Don’t understand why, Anthropic do released in EU too

That Teck Guy profil fotoğrafı
That Teck Guy4 ay önce

i dont see computer use or any updates and im not in the EU @JamesZmSun

Brad H profil fotoğrafı
Brad H4 ay önce

This feature is fantastic! I can't express it enough much this will help my workflow. THANK YOU!

Andrey profil fotoğrafı
Andrey4 ay önce

@DamiDina do agents really need visuals though?

NigerianVoice profil fotoğrafı
NigerianVoice4 ay önce

This is one of those small-feeling features that quietly changes how you build. Turning the browser into structured context (DOM + screenshot + intent) removes so much friction between “seeing” and “fixing.” Feels less like prompting and more like pair programming with the web itself.

dnu profil fotoğrafı
dnu4 ay önce

in-app browser is the right primitive. the failure mode i kept hitting was agents losing the exact page state after a refresh and then repeating bad clicks. are you persisting page context per task or mostly relying on screenshot history?

James Sun profil fotoğrafı
James Sun4 ay önce

we don't pass the page context to the agent yet. We have some safety work that we are doing this week to prevent against prompt injection, etc. Right now, the agent can only see screenshots if you comment, and the page title!

Reda Salmi profil fotoğrafı
Reda Salmi4 ay önce

waiting for linux support 👀

Joe Devon profil fotoğrafı
Joe Devon4 ay önce

My Macbook Pro with 16GB ram was already struggling w/ my AI use, I don't think I can try this out reliably, but I am very impressed with what you've done here and will eagerly try it when upgrading to a new Mac w/ Ram maxed out this time.

Gabe profil fotoğrafı
Gabe4 ay önce

Does this browser trigger an anti-crawler mechanism? For example, log in to reddit and leave a comment

Udit profil fotoğrafı
Udit4 ay önce

Can't use in app browser in windows codex app

James Sun profil fotoğrafı
James Sun4 ay önce

can you try updating? if it's not working, can you give me your version number & spec?

Udit profil fotoğrafı
Udit4 ay önce

Reinstalling it did work for me, thanks

Yash profil fotoğrafı
Yash4 ay önce

How to use it?

James Sun profil fotoğrafı
James Sun4 ay önce

If you open a localhost or local file link in Codex, it will open the browser! Otherwise, you can also use Cmd + Shift + B to open it up directly

Nick Woodhead | GPTree | Foremerge | TranslateTech profil fotoğrafı
Nick Woodhead | GPTree | Foremerge | TranslateTech4 ay önce

Point and click productivity just leveled up!

Adi Patel profil fotoğrafı
Adi Patel4 ay önce

thats pretty cool, gives me a reason to get back on codex

zenyP profil fotoğrafı
zenyP4 ay önce

@sama Fucking yes, I knew you were doing something on UI

MysterE profil fotoğrafı
MysterE4 ay önce

Does it still suck at front end design? Nobody wants ugly web pages

DigitalAssetBuzz 🔶 profil fotoğrafı
DigitalAssetBuzz 🔶4 ay önce

This looks genuinely useful. Real question though — how does this compare to what Claude Opus 4.7 is doing with its vision upgrade? They just shipped 3x image resolution and 98.5% visual acuity for computer use. Different approach but same problem: get the AI to actually see what you're seeing. What's Codex doing here that Opus can't?

Abhishek K Singh profil fotoğrafı
Abhishek K Singh4 ay önce

This is great! Can you all do something like this for markdowns/plans? It’d be great if one could review those almost like word/google docs and leave comments / annotations for the agent to address and then see/manage updates in a single spec/plan file.

rondd profil fotoğrafı
rondd4 ay önce

wow

Владислав Колесников profil fotoğrafı
Владислав Колесников4 ay önce

Good job, respect

Kevin Guaman profil fotoğrafı
Kevin Guaman4 ay önce

Awesome. Less screenshots will be taken

Chetan | 3D Websites Daily profil fotoğrafı
Chetan | 3D Websites Daily4 ay önce

@soumitrashukla9 wow this changes everything - finally i can point it to and make it update its own website lol :p

AstraCore profil fotoğrafı
AstraCore4 ay önce

Interesting! Does the DOM capture use something like a headless browser to get the full, post-JS-rendered state, or is it more of a static snapshot? Also, how does it handle dynamic SPAs where the DOM mutates frequently?

Senex profil fotoğrafı
Senex4 ay önce

Tried it out and.. not having full agent integration makes this rough. "No more switching between browsers or dragging screenshots" I.. already dont' have to do this with playwright, and not only that, the agent can actually see my screen. Hopefully we can get real benefits soon

David Pilcher profil fotoğrafı
David Pilcher4 ay önce

@sama Can I use it to browse a project website, capture screenshots and put together an initial user manual structure?

James Sun profil fotoğrafı
James Sun4 ay önce

@sama Yep! You can use it on remote websites as well :)

David Pilcher profil fotoğrafı
David Pilcher4 ay önce

@sama Great. Will give it a test!

Kingsley Uyi Idehen profil fotoğrafı
Kingsley Uyi Idehen4 ay önce

Here’s my variant of the Codex demo, as I didn’t quite grasp what was happening in the initial screencast. In my demo, I ask about the Virtuoso home page using its URL, then use the sidebar (very important) to open the built-in HTML browser. Once that’s in place, I’m able to perform operations such as deriving page descriptions in various structured data formats (JSON-LD, RDF-Turtle etc) for upload to my knowledge base. This knowledge base manifests as a Semantic Web, courtesy of Linked Data principles (i.e., naming entities and relationships using hyperlinks, and using those hyperlinks to construct RDF statements in subject–predicate–object, or entity–attribute–value form). Ultimately, this is just another step in the progression of knowledge base generation and management—supporting improved recall and reuse of data, information, and knowledge. From a modern business model perspective, in the age of AI, I also have the ability to monetize these knowledge bases using fine-grained, attribute-based access control (ABAC), where access is determined by evaluating attributes across the target knowledge base and the AI agents seeking access on behalf of human operations.

Chase Brignac 🚀 profil fotoğrafı
Chase Brignac 🚀4 ay önce

@sama BROOOOOOOOOOOOOOOOOOO

Morgan profil fotoğrafı
Morgan4 ay önce

This looks really cool James, looking forward to playing around with it!

Katz profil fotoğrafı
Katz4 ay önce

@ajambrosino Let’s goooo

frandev 🇦🇷 profil fotoğrafı
frandev 🇦🇷4 ay önce

Wow 🤯 this is really great

Benzer Videolar

EVERYTHING YOU NEED TO KNOW ABOUT CHATGPT'S "LOVABLE KILLER" CODEX SITES (in 25 mins): TLDR; the coolest part is that apps you build can update themselves autonomously 1. Codex Sites is not Replit or Lovable or Bolt. Those are great for one-prompting a full app. Codex Sites is for building apps that the agent keeps improving without you touching them. 2. Your personal website can update its own stats. Your internal dashboard can refresh its own data. Your product can add features while you sleep. The app is alive. 3. Start by invoking at-sites. Use realistic sample data. Always say "save for review, do not deploy." This unlocks building a real product, not a homepage. 4. Add persistent storage so the app remembers everything between visits. Without this it resets every time. Ask Codex to show you the data model before it builds. 5. Create safe actions. These are the specific things the agent is allowed to do to your app: add data, update cards, move things, score things. You define the boundaries. The agent operates within them. 6. Build skills so any future Codex chat knows how to interact with your app. The skill is basically a manual for the agent. Without it, every new chat starts from zero. 7. Save gate like a video game. Codex doesn't auto-save. Create checkpoints before you deploy so you can roll back if something breaks. 8. Close the autonomous loop. This is the magic. Once memory, safe actions, and skills are set up, the agent can update your app from any chat, any context, without you switching tabs. 9. Use the plugins most people are sleeping on. Figma, Canva, HeyGen for avatar videos, Game Studio for interactive experiences, FAL for image generation, Hugging Face for open source models. Worth adding a few. 10. The big picture: we went from building apps to raising apps. You set up the structure, the guardrails, and the skills. The agent does the rest. That's autonomous product building and it's here right now. Tbh, Codex sites isn't perfect. Still a lot to be desired like domains, db, authentication etc. But it's a glimpse into this idea that apps can be updated/improved upon automonously. And Codex Sites is REALLY good if you live in Codex everyday. Which more and more of are. And that's really cool. Will be interesting to see how Lovable, Bolt, Replit etc react to this. full tutorial on The Startup Ideas Podcast (SIP) 🧃 where you get your pods watch share with a friend i'm rooting for you What do you think of Codex and Codex sites?

GREG ISENBERG

69,219 görüntüleme • 3 ay önce