Загрузка видео...

Не удалось загрузить видео

На главную

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No...

405,205 просмотров • 4 месяцев назад •via X (Twitter)

Комментарии: 58

Фото профиля am.will
am.will4 месяцев назад

thanks for sharing james! so to confirm, the integrated browser is NOT live yet right?

Фото профиля James Sun
James Sun4 месяцев назад

Sorry it's hard to find right now! We'll be giving Codex the ability to drive the browser autonomously soon, so it will be much easier to discover :)

Фото профиля Andrew Mayne
Andrew Mayne4 месяцев назад

Any advice on getting Codex to trigger it? It still wants to use the Playwright tool even when the browser tab is open.

Фото профиля James Sun
James Sun4 месяцев назад

We haven't plugged in the browser-use agent yet, so the only agent workflow that Codex knows for the browser is iterating based on your comments! We'll ship an update next week that lets Codex fully drive the browser.

Фото профиля Andrew Mayne
Andrew Mayne4 месяцев назад

Thanks! Just having a built in browser is great! It really makes it the everything app.

Фото профиля Stephen Turner 🇬🇧🇺🇦
Stephen Turner 🇬🇧🇺🇦4 месяцев назад

Фото профиля James Sun
James Sun4 месяцев назад

It's on Windows!

Фото профиля Chrys Johnson
Chrys Johnson4 месяцев назад

@LittleBrainz Definitely isn't. The app itself is but the new capabilities arent

Фото профиля James Sun
James Sun4 месяцев назад

@LittleBrainz looking into this now

Фото профиля James Sun
James Sun4 месяцев назад

@LittleBrainz should be available, can you try updating?

Фото профиля James Sun
James Sun4 месяцев назад

@LittleBrainz If not, can you give me your specs and the version number of your Codex?

Фото профиля ່
4 месяцев назад

You guys should just make gpt5.4 good at frontend. This would be bomb!

Фото профиля James Sun
James Sun4 месяцев назад

we've got something cooking for you

Фото профиля ່
4 месяцев назад

🥹

Фото профиля beeman 📱
beeman 📱4 месяцев назад

@ajambrosino Amazing! Does it work like a regular browser when it comes to cookies etc? A lot of apps that I'm building need auth so they have to be logged in - this is often a hassle with playwright sessions, it never figures it out

Фото профиля James Sun
James Sun4 месяцев назад

@ajambrosino Hey! You should be able to auth provided there is email + password flow. The browser today is a bit limited because it doesn't support a few things like multiple tabs, web permissions, etc. We are incrementally bringing the full capabilities of a browser into this product!

Фото профиля Kierre Reeg
Kierre Reeg4 месяцев назад

Hello, so on the Codex mac app, the file tree browser needs a splitter so you can drag it so its wider on the horizontal axis. If you have deep file trees or long file names this view is much too constricted and it hurts usability.

Фото профиля James Sun
James Sun4 месяцев назад

thanks for the feedback, passing it to the team!

Фото профиля Kierre Reeg
Kierre Reeg4 месяцев назад

The other thing is for the excel file viewer, we need dark mode, its way too bright with all that white

Фото профиля Yaya Soumah
Yaya Soumah4 месяцев назад

@jxnlco I can’t make codex spin up the browser, and for computer use I see a message relayed to the fact that I don’t have a plugin. I’m confused

Фото профиля James Sun
James Sun4 месяцев назад

@jxnlco sorry about that! We are hooking up the agent with the browser next week, so you'll have to click on a localhost or local file link to open up the browser. For computer use, click settings, computer use and install the plugin :)

Фото профиля Yaya Soumah
Yaya Soumah4 месяцев назад

@jxnlco Here

Фото профиля James Sun
James Sun4 месяцев назад

@jxnlco Trying to see if this is because of EU. Are you based in Europe?

Фото профиля Yaya Soumah
Yaya Soumah4 месяцев назад

@jxnlco Yes, sorry, I read later that is not available in EU? Don’t understand why, Anthropic do released in EU too

Фото профиля That Teck Guy
That Teck Guy4 месяцев назад

i dont see computer use or any updates and im not in the EU @JamesZmSun

Фото профиля Brad H
Brad H4 месяцев назад

This feature is fantastic! I can't express it enough much this will help my workflow. THANK YOU!

Фото профиля Andrey
Andrey4 месяцев назад

@DamiDina do agents really need visuals though?

Фото профиля NigerianVoice
NigerianVoice4 месяцев назад

This is one of those small-feeling features that quietly changes how you build. Turning the browser into structured context (DOM + screenshot + intent) removes so much friction between “seeing” and “fixing.” Feels less like prompting and more like pair programming with the web itself.

Фото профиля dnu
dnu4 месяцев назад

in-app browser is the right primitive. the failure mode i kept hitting was agents losing the exact page state after a refresh and then repeating bad clicks. are you persisting page context per task or mostly relying on screenshot history?

Фото профиля James Sun
James Sun4 месяцев назад

we don't pass the page context to the agent yet. We have some safety work that we are doing this week to prevent against prompt injection, etc. Right now, the agent can only see screenshots if you comment, and the page title!

Фото профиля Reda Salmi
Reda Salmi4 месяцев назад

waiting for linux support 👀

Фото профиля Joe Devon
Joe Devon4 месяцев назад

My Macbook Pro with 16GB ram was already struggling w/ my AI use, I don't think I can try this out reliably, but I am very impressed with what you've done here and will eagerly try it when upgrading to a new Mac w/ Ram maxed out this time.

Фото профиля Gabe
Gabe4 месяцев назад

Does this browser trigger an anti-crawler mechanism? For example, log in to reddit and leave a comment

Фото профиля Udit
Udit4 месяцев назад

Can't use in app browser in windows codex app

Фото профиля James Sun
James Sun4 месяцев назад

can you try updating? if it's not working, can you give me your version number & spec?

Фото профиля Udit
Udit4 месяцев назад

Reinstalling it did work for me, thanks

Фото профиля Yash
Yash4 месяцев назад

How to use it?

Фото профиля James Sun
James Sun4 месяцев назад

If you open a localhost or local file link in Codex, it will open the browser! Otherwise, you can also use Cmd + Shift + B to open it up directly

Фото профиля Nick Woodhead | GPTree | Foremerge | TranslateTech
Nick Woodhead | GPTree | Foremerge | TranslateTech4 месяцев назад

Point and click productivity just leveled up!

Фото профиля Adi Patel
Adi Patel4 месяцев назад

thats pretty cool, gives me a reason to get back on codex

Фото профиля zenyP
zenyP4 месяцев назад

@sama Fucking yes, I knew you were doing something on UI

Фото профиля MysterE
MysterE4 месяцев назад

Does it still suck at front end design? Nobody wants ugly web pages

Фото профиля DigitalAssetBuzz 🔶
DigitalAssetBuzz 🔶4 месяцев назад

This looks genuinely useful. Real question though — how does this compare to what Claude Opus 4.7 is doing with its vision upgrade? They just shipped 3x image resolution and 98.5% visual acuity for computer use. Different approach but same problem: get the AI to actually see what you're seeing. What's Codex doing here that Opus can't?

Фото профиля Abhishek K Singh
Abhishek K Singh4 месяцев назад

This is great! Can you all do something like this for markdowns/plans? It’d be great if one could review those almost like word/google docs and leave comments / annotations for the agent to address and then see/manage updates in a single spec/plan file.

Фото профиля rondd
rondd4 месяцев назад

wow

Фото профиля Владислав Колесников
Владислав Колесников4 месяцев назад

Good job, respect

Фото профиля Kevin Guaman
Kevin Guaman4 месяцев назад

Awesome. Less screenshots will be taken

Фото профиля Chetan | 3D Websites Daily
Chetan | 3D Websites Daily4 месяцев назад

@soumitrashukla9 wow this changes everything - finally i can point it to and make it update its own website lol :p

Фото профиля AstraCore
AstraCore4 месяцев назад

Interesting! Does the DOM capture use something like a headless browser to get the full, post-JS-rendered state, or is it more of a static snapshot? Also, how does it handle dynamic SPAs where the DOM mutates frequently?

Фото профиля Senex
Senex4 месяцев назад

Tried it out and.. not having full agent integration makes this rough. "No more switching between browsers or dragging screenshots" I.. already dont' have to do this with playwright, and not only that, the agent can actually see my screen. Hopefully we can get real benefits soon

Фото профиля David Pilcher
David Pilcher4 месяцев назад

@sama Can I use it to browse a project website, capture screenshots and put together an initial user manual structure?

Фото профиля James Sun
James Sun4 месяцев назад

@sama Yep! You can use it on remote websites as well :)

Фото профиля David Pilcher
David Pilcher4 месяцев назад

@sama Great. Will give it a test!

Фото профиля Kingsley Uyi Idehen
Kingsley Uyi Idehen4 месяцев назад

Here’s my variant of the Codex demo, as I didn’t quite grasp what was happening in the initial screencast. In my demo, I ask about the Virtuoso home page using its URL, then use the sidebar (very important) to open the built-in HTML browser. Once that’s in place, I’m able to perform operations such as deriving page descriptions in various structured data formats (JSON-LD, RDF-Turtle etc) for upload to my knowledge base. This knowledge base manifests as a Semantic Web, courtesy of Linked Data principles (i.e., naming entities and relationships using hyperlinks, and using those hyperlinks to construct RDF statements in subject–predicate–object, or entity–attribute–value form). Ultimately, this is just another step in the progression of knowledge base generation and management—supporting improved recall and reuse of data, information, and knowledge. From a modern business model perspective, in the age of AI, I also have the ability to monetize these knowledge bases using fine-grained, attribute-based access control (ABAC), where access is determined by evaluating attributes across the target knowledge base and the AI agents seeking access on behalf of human operations.

Фото профиля Chase Brignac 🚀
Chase Brignac 🚀4 месяцев назад

@sama BROOOOOOOOOOOOOOOOOOO

Фото профиля Morgan
Morgan4 месяцев назад

This looks really cool James, looking forward to playing around with it!

Фото профиля Katz
Katz4 месяцев назад

@ajambrosino Let’s goooo

Фото профиля frandev 🇦🇷
frandev 🇦🇷4 месяцев назад

Wow 🤯 this is really great

Похожие видео

EVERYTHING YOU NEED TO KNOW ABOUT CHATGPT'S "LOVABLE KILLER" CODEX SITES (in 25 mins): TLDR; the coolest part is that apps you build can update themselves autonomously 1. Codex Sites is not Replit or Lovable or Bolt. Those are great for one-prompting a full app. Codex Sites is for building apps that the agent keeps improving without you touching them. 2. Your personal website can update its own stats. Your internal dashboard can refresh its own data. Your product can add features while you sleep. The app is alive. 3. Start by invoking at-sites. Use realistic sample data. Always say "save for review, do not deploy." This unlocks building a real product, not a homepage. 4. Add persistent storage so the app remembers everything between visits. Without this it resets every time. Ask Codex to show you the data model before it builds. 5. Create safe actions. These are the specific things the agent is allowed to do to your app: add data, update cards, move things, score things. You define the boundaries. The agent operates within them. 6. Build skills so any future Codex chat knows how to interact with your app. The skill is basically a manual for the agent. Without it, every new chat starts from zero. 7. Save gate like a video game. Codex doesn't auto-save. Create checkpoints before you deploy so you can roll back if something breaks. 8. Close the autonomous loop. This is the magic. Once memory, safe actions, and skills are set up, the agent can update your app from any chat, any context, without you switching tabs. 9. Use the plugins most people are sleeping on. Figma, Canva, HeyGen for avatar videos, Game Studio for interactive experiences, FAL for image generation, Hugging Face for open source models. Worth adding a few. 10. The big picture: we went from building apps to raising apps. You set up the structure, the guardrails, and the skills. The agent does the rest. That's autonomous product building and it's here right now. Tbh, Codex sites isn't perfect. Still a lot to be desired like domains, db, authentication etc. But it's a glimpse into this idea that apps can be updated/improved upon automonously. And Codex Sites is REALLY good if you live in Codex everyday. Which more and more of are. And that's really cool. Will be interesting to see how Lovable, Bolt, Replit etc react to this. full tutorial on The Startup Ideas Podcast (SIP) 🧃 where you get your pods watch share with a friend i'm rooting for you What do you think of Codex and Codex sites?

GREG ISENBERG

69,219 просмотров • 3 месяцев назад