James Sun's banner

James Sun

@JamesZmSun • 7,952 subscribers

browsers & browser use for Codex & ChatGPT @openai prev: @thirdweb, @papercheckout, @Twitch, YC S16

Shorts

Two more ships this week for the ChatGPT Desktop in-app browser! Media Tabs: Find your music or meeting without hunting through threads! All tabs with audio/video activity are now grouped in one menu in the side pane. (s/o Khoi Nguyen Josh D) Zero-state autocomplete: Jump back into your browser work faster. Just click the empty URL bar to see your most recently visited pages. (s/o Oliver Tepman) Let us know what you think, especially if you’re using the IAB as your daily driver. We are still working on bringing extension support safely to the IAB, thanks for your patience!

Two more ships this week for the ChatGPT Desktop in-app browser! Media Tabs: Find your music or meeting without hunting through threads! All tabs with audio/video activity are now grouped in one menu in the side pane. (s/o Khoi Nguyen Josh D) Zero-state autocomplete: Jump back into your browser work faster. Just click the empty URL bar to see your most recently visited pages. (s/o Oliver Tepman) Let us know what you think, especially if you’re using the IAB as your daily driver. We are still working on bringing extension support safely to the IAB, thanks for your patience!

27,943 views

Videos

Anya Rossi

sweetdream.ai

SweetDream.ai•Sponsored•Livecam

Watch Anya Live

Anya is streaming live right now! Join her private show and enjoy exclusive content.

Exclusive private shows

1.2k viewers online

Private Show

Join now for exclusive access

Free preview available • Premium content

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No more switching between browsers, dragging screenshots, and wrangling with underspecified prompts. It's great for front-end development of apps/pages, but also very useful if you have documentation pulled up on the side and just want to ask a question!

We are super excited to launch the in-app browser inside Codex with comment mode! View any web pages & iterate with your agent quickly with just point and click. Codex will automatically capture a screenshot, the DOM element, and feed it as precise context to your next chat. No more switching between browsers, dragging screenshots, and wrangling with underspecified prompts. It's great for front-end development of apps/pages, but also very useful if you have documentation pulled up on the side and just want to ask a question!

405,205 views • 4 months ago

Codex can now use the in-app browser to test your app at different viewport sizes! It will control the device tool bar and click through your app at different breakpoints to validate & iterate. If it's a long run, Codex will take screenshots at key moments during testing and show them to you at the end of the turn, so you can verify its work. To speed up testing, Codex can hide the IAB to disable animations, and accelerate testing by 1-2x. Separately, we also made annotations send faster and consume less tokens. Hope you enjoy the updates and let us know what you think!

Codex can now use the in-app browser to test your app at different viewport sizes! It will control the device tool bar and click through your app at different breakpoints to validate & iterate. If it's a long run, Codex will take screenshots at key moments during testing and show them to you at the end of the turn, so you can verify its work. To speed up testing, Codex can hide the IAB to disable animations, and accelerate testing by 1-2x. Separately, we also made annotations send faster and consume less tokens. Hope you enjoy the updates and let us know what you think!

228,869 views • 4 months ago

Today, we launched browser use inside Codex to further close the build & verify loop for local development! Now, you can ask Codex to build your front end, and test it like a user would by clicking through the app. Codex sees everything a user sees through vision & checks the network/console logs to help debug & fix any issues that it finds. This change brings us closer to fully autonomous coding agents that delivers high quality and tested changes. Watch Codex test my app in the browser, catch & fix a real bug, and doing that loop again with a brand new feature.

226,907 views • 4 months ago

We added a device tool bar to the Codex in-app browser, so it's easier to build and test responsive apps! Now, you can have Codex test your app in different dimensions, so it can fix bugs & improve UI for every device. Just click the 3 dots on the right of the URL bar to use it! As part of this change, we also: - improved the speed of browser use (~30% in my vibe testing) - tightened the animation of the cursor - added a way to hide the composer in full screen mode - fixed a few bugs for browser use in Windows Oliver Tepman and John Nastos cooked on this one! Try it out and let us know what you think!

We added a device tool bar to the Codex in-app browser, so it's easier to build and test responsive apps! Now, you can have Codex test your app in different dimensions, so it can fix bugs & improve UI for every device. Just click the 3 dots on the right of the URL bar to use it! As part of this change, we also: - improved the speed of browser use (~30% in my vibe testing) - tightened the animation of the cursor - added a way to hide the composer in full screen mode - fixed a few bugs for browser use in Windows Oliver Tepman and John Nastos cooked on this one! Try it out and let us know what you think!

148,458 views • 4 months ago

Last week was Windows, this week goes out to the mobile devs! Now, you can build, test, iterate on iOS apps much faster inside Codex. You can now: - Give precise feedback on your app's UI to Codex using annotation mode - Ask Codex to test every element and orientation of your app using the browser. Try it by installing the Build iOS Apps plugin. s/o to Evan Bacon 🥓 for serve-sim that allows us to make this possible & Rounak Jain who cooked to get this one out!

Last week was Windows, this week goes out to the mobile devs! Now, you can build, test, iterate on iOS apps much faster inside Codex. You can now: - Give precise feedback on your app's UI to Codex using annotation mode - Ask Codex to test every element and orientation of your app using the browser. Try it by installing the Build iOS Apps plugin. s/o to Evan Bacon 🥓 for serve-sim that allows us to make this possible & Rounak Jain who cooked to get this one out!

17,849 views • 3 months ago

Another week of shipping at Atlas! Excited to share these with you: - Save prompts that you use frequently and access them anywhere with @ and in the bookmarks bar - Rename your tabs - Device tab in Dev Tools so you can see how websites respond on different devices - Smarter transition between agent mode/chat so you are not stuck in the wrong mode - Bug fixes across autofill, extensions, side chat suggestions, and picture-in-picture Just hit the update button on the top right to get the latest goodies.

Another week of shipping at Atlas! Excited to share these with you: - Save prompts that you use frequently and access them anywhere with @ and in the bookmarks bar - Rename your tabs - Device tab in Dev Tools so you can see how websites respond on different devices - Smarter transition between agent mode/chat so you are not stuck in the wrong mode - Bug fixes across autofill, extensions, side chat suggestions, and picture-in-picture Just hit the update button on the top right to get the latest goodies.

20,700 views • 7 months ago

No more content to load