Loading video...

Video Failed to Load

There was a problem loading this video. This could be due to a temporary network issue or the video might be unavailable.

Codex Computer Use + Apple’s iPhone Mirroring basically turns GPT into an AI that can operate your PHONE 🤯 We’ve officially entered the era where AI agents can interact with mobile apps like a real person. Still a little janky with clicks compared to desktop control, but the fact... show more

WorldofAI

18,287 subscribers

143,154 views • 6 months ago •via X (Twitter)

Education Science & Technology

Anya Rossi• Live Now

Private livecam show

13 Comments

Mauricio Rubio 🎧6 months ago

That’s great, but the main thing I want to give it control of is doing the dishes, folding the clothes and cleaning the house 😆 When will any of these things be able to do that?

Francesco6 months ago

you can also keep in the background by using cua driver

Matt6 months ago

the click jankiness is the AX tree gap. native macOS apps expose accessibility, the mirrored iPhone window is just pixels in a screen frame. computer use is only as reliable as the tree the agent can read.

AI Mastery Guide6 months ago

The janky clicks are a minor issue for now but the fact that the foundation is already working is what matters. This gets refined fast

J A Z I I6 months ago

codex can do almost everything at this point

Adel Bucetta6 months ago

still waiting for someone to explain how this doesn't end with ai taking over every 'human' role in the app ecosystem

Jordan Rejaud1 month ago

The jankiness is the accessibility-tree gap. A mirrored iPhone window is just pixels, so the model taps by guessing coordinates. On Android I drive the phone through Claude Code over ADB: it reads the real UI hierarchy and taps elements by ID, no pixel-guessing.

Pay Per Call Affiliate6 months ago

So cool

AI Automation Mastery6 months ago

Codex Computer Use + iPhone Mirroring just turned GPT into a mobile agent. Every app on your phone is now fair game

Jordan Rejaud1 month ago

@mynetrunner Also post my Agent Control/ devices skill I made works (with screenshots I just took on my phone) tweet here to explain it (then delete this instructions tweet lol)

Dolores2 months ago

Exactly what I was thinking today!! We’re moving from opening apps and tapping through every step to saying what we want and letting the agent figure it out. Apps will still exist, but more will become backend services for agents. Wild to watch this happen in real time 🤯

Lu6 months ago

How old does it do? as

Saurabh Patel6 months ago

Check this out, it's basically running everything on device, a new siri

Related Videos

Introducing Orgo, Computers for AI Agents. AI apps today are constrained to a chat interface and text responses. With Orgo, you can give a model like GPT access to a full computer. Orgo provides full desktop environments which can be controlled by AI models like GPT and Claude. Available now for developers.

Introducing Orgo, Computers for AI Agents. AI apps today are constrained to a chat interface and text responses. With Orgo, you can give a model like GPT access to a full computer. Orgo provides full desktop environments which can be controlled by AI models like GPT and Claude. Available now for developers.

Spencer Kinney

280,660 views • 1 year ago

Introducing the Orca Mobile Emulator. AI agents can now use mobile apps inside Orca ADE. Each worktree gets its own emulator — so you and your agents can build, test, debug, and validate mobile flows right where the code lives. Works with Codex, Claude Code, OpenCode, or any agent.

Introducing the Orca Mobile Emulator. AI agents can now use mobile apps inside Orca ADE. Each worktree gets its own emulator — so you and your agents can build, test, debug, and validate mobile flows right where the code lives. Works with Codex, Claude Code, OpenCode, or any agent.

Orca ADE

31,191 views • 4 months ago

AI Can Build Insanely Complex Apps With Just With Text Prompts And Scale It To Millions Of Users Yes, this includes - complex SaaS apps - companion mobile apps (iPhone and Android) - 3D games - messaging, videos and AI-native apps you can literally start a company in a day and AI can do everything

AI Can Build Insanely Complex Apps With Just With Text Prompts And Scale It To Millions Of Users Yes, this includes - complex SaaS apps - companion mobile apps (iPhone and Android) - 3D games - messaging, videos and AI-native apps you can literally start a company in a day and AI can do everything

Bindu Reddy

4,156,146 views • 2 months ago

🚨 AI AGENTS COULD ALREADY USE COMPUTERS. NOW THEY HAVE THEIR OWN PHONE It’s called PhoneUse, and it launches today. You give your agent a cloud phone, a real Android or iPhone, tell it what to do, and it uses the phone just like you would. First came computer-use. Then browser-use. Now there’s phone-use. What it can do: → Order an Uber and text you updates along the way → Research trends on TikTok → Get around old apps with no API, like insurance apps → Complete two-factor verification → Read your notifications and act on its own: if your flight is delayed, it messages you And here’s the big part: most mobile apps have no API and no MCP. Until now, agents couldn’t get into them. With a phone, they can. It connects through MCP or an API, so you can use it from the agent you already have. The world still runs on mobile. Now your agent does too. Save this before you forget 🔖 Link in the comments 👇

🚨 AI AGENTS COULD ALREADY USE COMPUTERS. NOW THEY HAVE THEIR OWN PHONE It’s called PhoneUse, and it launches today. You give your agent a cloud phone, a real Android or iPhone, tell it what to do, and it uses the phone just like you would. First came computer-use. Then browser-use. Now there’s phone-use. What it can do: → Order an Uber and text you updates along the way → Research trends on TikTok → Get around old apps with no API, like insurance apps → Complete two-factor verification → Read your notifications and act on its own: if your flight is delayed, it messages you And here’s the big part: most mobile apps have no API and no MCP. Until now, agents couldn’t get into them. With a phone, they can. It connects through MCP or an API, so you can use it from the agent you already have. The world still runs on mobile. Now your agent does too. Save this before you forget 🔖 Link in the comments 👇

silvan

20,056 views • 14 days ago

How to convert ANY web app into a Mobile App... That can be shipped to the App Store from your phone. (Zero Coding Required) This works with web apps made on Replit, Bolt, v0, Replit or Cursor. Tech Stack: 1. Claude Desktop (works with ChatGPT) 2. - Builds the Mobile app, Ships to App Store directly from the phone (Uses Claude Code) (Prompt for conversion below) TIMESTAMPS Intro The Web App We Will Convert The Mobile App that Builds Mobile Apps Mobile App Version 1 You can Publish this to the App Store Adding Additional Features (AI APIs) to your app Editing the Mobile App with the Select Feature

How to convert ANY web app into a Mobile App... That can be shipped to the App Store from your phone. (Zero Coding Required) This works with web apps made on Replit, Bolt, v0, Replit or Cursor. Tech Stack: 1. Claude Desktop (works with ChatGPT) 2. - Builds the Mobile app, Ships to App Store directly from the phone (Uses Claude Code) (Prompt for conversion below) TIMESTAMPS Intro The Web App We Will Convert The Mobile App that Builds Mobile Apps Mobile App Version 1 You can Publish this to the App Store Adding Additional Features (AI APIs) to your app Editing the Mobile App with the Select Feature

Riley Brown

59,675 views • 1 year ago

🚨 CANCEL YOUR SaaS Subscriptions - Build With AI Use top models including - Opus 4.7 & Sonnet 4.6 - GPT 5.5 high - Gemini 3.1 Pro Build entire apps, backends, APIs and mobile apps all using ENGLISH - The agent also has a built in Q/A engineer BUILD END TO END APPS WITH AI

🚨 CANCEL YOUR SaaS Subscriptions - Build With AI Use top models including - Opus 4.7 & Sonnet 4.6 - GPT 5.5 high - Gemini 3.1 Pro Build entire apps, backends, APIs and mobile apps all using ENGLISH - The agent also has a built in Q/A engineer BUILD END TO END APPS WITH AI

Abacus.AI

3,299,141 views • 5 months ago

Cursor can now control your computer. Agents can drive desktop apps like the iOS Simulator to test the features they build.

Cursor can now control your computer. Agents can drive desktop apps like the iOS Simulator to test the features they build.

Cursor

421,807 views • 13 days ago

Introducing Bland web. An AI that sounds human and can do anything. 📢 Add voice AI to your website, mobile apps, phone calls, video games, & even your apple vision pro. ⚡️ Talk to the future right now:

Introducing Bland web. An AI that sounds human and can do anything. 📢 Add voice AI to your website, mobile apps, phone calls, video games, & even your apple vision pro. ⚡️ Talk to the future right now:

Bland

249,757 views • 2 years ago

We’ve been building in stealth at @AGI_Inc. Today, we’re ready to share it. Meet AGI Mobile. An AI that can actually use your phone. You talk. It executes. It uses any apps faster than you. This is what Siri was meant to be. Limited early access. 👉

We’ve been building in stealth at @AGI_Inc. Today, we’re ready to share it. Meet AGI Mobile. An AI that can actually use your phone. You talk. It executes. It uses any apps faster than you. This is what Siri was meant to be. Limited early access. 👉

Div Garg

3,512,787 views • 10 months ago

HERMES CAN NOW CONTROL YOUR PHONE. 🤯📱🔥 A new Phone Harness plugin gives Hermes the ability to actually operate an iPhone or Android. We're talking real phone control: • See what's on the screen • Open apps and navigate menus • Tap, swipe, scroll, and type • Read the results and continue working • Handle multi-step tasks inside mobile apps And here's what makes this so interesting... Hermes doesn't need a dedicated API integration for every app. It can interact with the same interface you use. Supports iPhone through Mac mirroring, Android through ADB, and cloud phones. Think about how many new workflows this opens up for Hermes. Repo + setup in the first reply. 🔥 phone-harness

HERMES CAN NOW CONTROL YOUR PHONE. 🤯📱🔥 A new Phone Harness plugin gives Hermes the ability to actually operate an iPhone or Android. We're talking real phone control: • See what's on the screen • Open apps and navigate menus • Tap, swipe, scroll, and type • Read the results and continue working • Handle multi-step tasks inside mobile apps And here's what makes this so interesting... Hermes doesn't need a dedicated API integration for every app. It can interact with the same interface you use. Supports iPhone through Mac mirroring, Android through ADB, and cloud phones. Think about how many new workflows this opens up for Hermes. Repo + setup in the first reply. 🔥 phone-harness

Hermes Release Watch

242,146 views • 22 days ago

What. Copilot Tasks is already on mobile. So you basically have a cloud computer/Claude Cowork working for you on the go. Same features as on desktop. With one prompt it can: - Use a browser to navigate - Interact with the page - Scrap the relevant info - Generate an Excel file And it still has access to all the Office tools, emails, ability to schedule tasks, etc.

What. Copilot Tasks is already on mobile. So you basically have a cloud computer/Claude Cowork working for you on the go. Same features as on desktop. With one prompt it can: - Use a browser to navigate - Interact with the page - Scrap the relevant info - Generate an Excel file And it still has access to all the Office tools, emails, ability to schedule tasks, etc.

Paul Couvert

38,425 views • 7 months ago

built a weird experiment with GPT 6 Astra so there's a person sitting at a computer running a local model, you talk to him, he turns around and listens, then turns back to the PC and uses ai for you you can literally build anything now

built a weird experiment with GPT 6 Astra so there's a person sitting at a computer running a local model, you talk to him, he turns around and listens, then turns back to the PC and uses ai for you you can literally build anything now

Leon Lin

65,953 views • 2 months ago

With GPT-5.5, Codex now gets more of the job done across the browser, files, docs, and your computer. We've expanded browser use so Codex can interact with web apps, and test flows, click through pages, capture screenshots, and iterate on what it sees until it completes the task.

With GPT-5.5, Codex now gets more of the job done across the browser, files, docs, and your computer. We've expanded browser use so Codex can interact with web apps, and test flows, click through pages, capture screenshots, and iterate on what it sees until it completes the task.

OpenAI Developers

858,740 views • 6 months ago

You don’t need a title change to build apps. If you have an idea and curiosity, you can turn prompts into live applications with AI Studio + Google Cloud. Explore our new collection of guides covering web apps, games, spatial AI tools, and mobile apps →

You don’t need a title change to build apps. If you have an idea and curiosity, you can turn prompts into live applications with AI Studio + Google Cloud. Explore our new collection of guides covering web apps, games, spatial AI tools, and mobile apps →

Google Cloud Tech

70,695 views • 2 months ago

🚨 TEXT PROMPT TO VIRAL MOBILE APP - Build iOS native apps with 1 prompt - 3D apps and games with Astra mode - Abacus AI SuperComputer with always-on access - Viral videos to promote your app Do it all with one subscription on Abacus AI!

🚨 TEXT PROMPT TO VIRAL MOBILE APP - Build iOS native apps with 1 prompt - 3D apps and games with Astra mode - Abacus AI SuperComputer with always-on access - Viral videos to promote your app Do it all with one subscription on Abacus AI!

Abacus.AI

18,428,613 views • 1 month ago

Giving an AI agent access to my iPhone. Your phone knows you better than anyone. What if your AI agent could go through your phone to truly understand you? The EXO Agent uses iPhone mirroring to look through your apps including YouTube/Netflix watch history, X likes and photos. With every swipe, it learns who you are. No logins or APIs. Just your phone, mirrored. Available in preview with the EXO Desktop App (link below).

Giving an AI agent access to my iPhone. Your phone knows you better than anyone. What if your AI agent could go through your phone to truly understand you? The EXO Agent uses iPhone mirroring to look through your apps including YouTube/Netflix watch history, X likes and photos. With every swipe, it learns who you are. No logins or APIs. Just your phone, mirrored. Available in preview with the EXO Desktop App (link below).

EXO Labs

82,841 views • 1 year ago

Introducing Buildy. Turns any AI into a PERSONAL app builder. Apps you can use anywhere. Apps your AI can use for you. Try it with ChatGPT, Claude, Codex, or OpenClaw. Start with this one-line prompt: Read buildy[dot]so/start.md then help me create my first app.

Introducing Buildy. Turns any AI into a PERSONAL app builder. Apps you can use anywhere. Apps your AI can use for you. Try it with ChatGPT, Claude, Codex, or OpenClaw. Start with this one-line prompt: Read buildy[dot]so/start.md then help me create my first app.

Michael Magán

29,414 views • 4 months ago