正在加载视频...

视频加载失败

Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone. Watch Claude control my phone and successfully look up stats in my Sports app. I even got it to play a game in the Chess app against another AI - pretty crazy. And this is...

607,231 次观看 • 1 年前 •via X (Twitter)

9 条评论

Mckay Wrigley 的头像
Mckay Wrigley1 年前

I’ll drop the actual code for this once I clean it up a bit. Allows you to run Claude with the computer use tool on your actual computer. Pretty impressed with how good it is at moving mouse and clicking around. Though you can tell it’s RLHF’d to avoid logins, messages, etc.

Nick Dobos 的头像
Nick Dobos1 年前

Oh wait this is genius!!! Was literally thinking yesterday “I wish there was a way do to this on iPhone” Why didn’t I think of mirroring my phone!?

Mckay Wrigley 的头像
Mckay Wrigley1 年前

It’s very fun! Got it to play Uno on the app haha. Turn based games are a fun challenge.

Prompter 的头像
Prompter1 年前

i built this little app to clean up my google drive and all of it's poorly named or unnamed files. excited to see how to expand this to my iphone and desktop with Claude!

Digital Vaquero 的头像
Digital Vaquero1 年前

Can’t wait to let it pick my bets /s

Mckay Wrigley 的头像
Mckay Wrigley1 年前

@Sebs_estudio “Pick me a winning 6 team parlay on Fanduel” LOL

Ajay Jagota 🔑🏃‍♂️ 的头像
Ajay Jagota 🔑🏃‍♂️1 年前

Could it theoretically listen to your voicemail and then send an agent the message and which formulates tasks based on the content of the message?

Mckay Wrigley 的头像
Mckay Wrigley1 年前

Once they allow voice input as a modality then yes, but not currently

Gareth Blake Hall 的头像
Gareth Blake Hall1 年前

So really you don’t need to build some LLM tools anymore. If a LLM decides it needs to take an action, e.g. say just chatting to bot and ask it to order you some food, it can go ahead, find the website and place the order for you. It’s amazing for sure and a missing component.

相关视频

I built a mobile app to check Paddle revenue (because they don't have one): 👉 - Use your Paddle API key (read-only and scoped) - Live data with beautiful and useful graphs built with native Swift UI. - Multi-account supported, unified revenue metrics. - Data stay on device, no server (api requests are sent directly from your phone) - Home widgets - I made it free to download on App Store (once it's approved) - Buy the source code for $19 and customize it however you want (save 5hrs of prompting if you try to do it yourself). Some interesting facts about this side project: - I vibe coded with 100% claude code remotely on my Mac Mini (with my AI assistant setup) in less than 24 hours. - I have read 0 line of code in this project and never opened Xcode myself. - My AI assistant designed the app with GPT Image 2, built the app with Swift UI, test it on simulator (via screenshots), send the test build to TestFlight for me to test, and invited me to the app store connect account so I can test on my phone, then the AI submitted the app to App Store and currently waiting for approval. - For the website, I ask it to come up with a domain name, I bought it via manually and give it access via Cloudflare API, the AI design and create a static website with GitHub, test it with lighthouse CLI, deploy via GitHub pages, config the domain DNS, deploy the website. - Then I sign up an account with Polar payment, create an API key and ask the AI to setup a store, add payment, link with the account, and add the payment to the website. The entire process happened in the last 24 hours with me only talking to the AI via Telegram. This is such a fun side project not only to create an app that I wish exists, but also to push the limit of what I can use AI for, and so far I'm very impressed. I'll create so much more apps! It feels like I have unlocked a super power.

Tony Dinh

43,529 次观看 • 1 个月前