OpenClaw can now use your iPhone! Peter Steinberger 🦞

📱🦞You can try it out too: Ask @openclaw to use this skill Note: - one-time setup needed - Mac + iPhone must be on the same Wi-Fi - It's a bit slow due to UI test round trips

@openclaw It can also swipe for you on tinder

OpenClaw can also use your Android device!

@steipete Are we watching the same video? This is awful?

very useful to let AI verify its coding work.

@steipete Bro this is insane, maybe you can integrate tailscale as well so that the devjce stays in the same network

@steipete I did try tailscale, but Xcode's "connect via network" pairing refuses to work on TS

@mohittwwt @steipete I just connected my MacBook Pro as a openclaw node with tail and I didn’t run into any Xcode issues

@mohittwwt @steipete Maybe it’s not the same with an iPhone

@mohittwwt Yeah openclaw works over TS, but Xcode isn’t able to connect to the iPhone in this setup

@steipete Nice I tried the same but using shortcuts

@steipete nice, what all is achievable through shortcuts? I believe third party apps need to manually expose intents for this to work?

@steipete A lot more than you might expect! Yeah they work through app intents - luckily the good apps already support them

@steipete why tf would you even want to do this

Allows AI to verify its code

@steipete @grok can you turn off his bluetooth and explain him how dumb it is saying that to an AI instead of doing it themselves

@steipete Ok openclaw switch off my Bluetooth Meanwhile me who did it faster

@steipete getting closerr

great… now this can be done without any jailbreak. just one time mac setup and same wifi for both devices. it is slow now i was watching a demo the other day and it’s slow because of all the ui round trips but still pretty wild seeing the phone screen change from a chat message. Android version already there too. Might get useful once latency drops or it starts doing chained stuff like open app then find setting then toggle something deeper.

@steipete Or maybe you swipe down and tap a button 🤷‍♂️

@steipete @anamhira @LandseerEnga yall should make some mobile infra for controlling openclaw agents on iOS

@steipete Yo can it swipe tinder for you? Asking for a friend 😂😂😂

Yes

Game over 😂 maybe it can train to know what type of girl/guy the user prefer and only swipe those 🫡

@steipete This is awesome. What do you think is the likelihood Apple will allow it to be downloaded from App Store?

@JoeAbbud It requires XCTest, so 0% likelihood

@steipete This is amazing, gonna help a lot with automated testing of features. Do new bundle IDs need to be added for each app you want it to work with? Shortcuts specifically would be quite cool to have.

@steipete It can also look at the Home Screen for unknown bundle ids. But models usually are pretty good about knowing bundle ids for a lot of apps.

@steipete @onlinedopamine 👀

@steipete onboard your agent on clawnew

@steipete More safe with Siri Shortcuts instead. Been doing this.

@steipete Oh wow

built the lobster that now owns your pocket device. Your iPhone's no longer safe from its own AI overlordOpenClaw just unlocked iPhone domination: now it can tap, swipe, type, screenshot, and control your phone directly via a new PhoneAgent skill. Mac + same Wi-Fi required, one-time setup, a bit slow on UI round-trips — but no APIs needed, just plain agent magic.@steipete

@steipete what about this instead?

@steipete Hey Siri, disable Bluetooth ✔️

@steipete I don’t feel comfortable watching you typeslide…

@steipete Insane

@steipete Super cool

@steipete Can we have an iphone skill on clawhub?

@steipete I don’t feel safe giving Israel control of my phone. Nice try.

@steipete How much did it cost you just to disable Bluetooth on your phone Get this shit automation off my tl

@steipete this AGI? cool now unlock my screen

@steipete is this even safe ?

@steipete when will we get here? the chinese have been cooking...

@steipete That seems to be a marvelous example of the tool’s usage

@steipete One step closer to the day I can just ship hoodies directly to humans without them even asking