Codex Computer Use + Apple’s iPhone Mirroring basically turns GPT into an AI that can operate your PHONE 🤯 We’ve officially entered the era where AI agents can interact with mobile apps like a real person. Still a little janky with clicks compared to desktop control, but the fact... it works at all is absolutely insane. Imagine giving GPT access to Uber, Instagram, TikTok, banking apps, mobile games, literally anything… 👀show more

That’s great, but the main thing I want to give it control of is doing the dishes, folding the clothes and cleaning the house 😆 When will any of these things be able to do that?

you can also keep in the background by using cua driver

the click jankiness is the AX tree gap. native macOS apps expose accessibility, the mirrored iPhone window is just pixels in a screen frame. computer use is only as reliable as the tree the agent can read.

The janky clicks are a minor issue for now but the fact that the foundation is already working is what matters. This gets refined fast

codex can do almost everything at this point

still waiting for someone to explain how this doesn't end with ai taking over every 'human' role in the app ecosystem

The jankiness is the accessibility-tree gap. A mirrored iPhone window is just pixels, so the model taps by guessing coordinates. On Android I drive the phone through Claude Code over ADB: it reads the real UI hierarchy and taps elements by ID, no pixel-guessing.

So cool

Codex Computer Use + iPhone Mirroring just turned GPT into a mobile agent. Every app on your phone is now fair game

@mynetrunner Also post my Agent Control/ devices skill I made works (with screenshots I just took on my phone) tweet here to explain it (then delete this instructions tweet lol)

Exactly what I was thinking today!! We’re moving from opening apps and tapping through every step to saying what we want and letting the agent figure it out. Apps will still exist, but more will become backend services for agents. Wild to watch this happen in real time 🤯

How old does it do? as

Check this out, it's basically running everything on device, a new siri