Video yükleniyor...

Video Yüklenemedi

Ana Sayfaya Dön

Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone. Watch Claude control my phone and successfully look up stats in my Sports app. I even got it to play a game in the Chess app against another AI - pretty crazy. And this is...

mckaywrigley's profile picture

Mckay Wrigley

227,911 subscribers

607,231 görüntüleme • 1 yıl önce •via X (Twitter)

Bilim & TeknolojiEğitimSpor
LIVE

Anya Rossi• Live Now

Private livecam show

9 Yorum

Mckay Wrigley profil fotoğrafı
Mckay Wrigley1 yıl önce

I’ll drop the actual code for this once I clean it up a bit. Allows you to run Claude with the computer use tool on your actual computer. Pretty impressed with how good it is at moving mouse and clicking around. Though you can tell it’s RLHF’d to avoid logins, messages, etc.

Nick Dobos profil fotoğrafı
Nick Dobos1 yıl önce

Oh wait this is genius!!! Was literally thinking yesterday “I wish there was a way do to this on iPhone” Why didn’t I think of mirroring my phone!?

Mckay Wrigley profil fotoğrafı
Mckay Wrigley1 yıl önce

It’s very fun! Got it to play Uno on the app haha. Turn based games are a fun challenge.

Prompter profil fotoğrafı
Prompter1 yıl önce

i built this little app to clean up my google drive and all of it's poorly named or unnamed files. excited to see how to expand this to my iphone and desktop with Claude!

Digital Vaquero profil fotoğrafı
Digital Vaquero1 yıl önce

Can’t wait to let it pick my bets /s

Mckay Wrigley profil fotoğrafı
Mckay Wrigley1 yıl önce

@Sebs_estudio “Pick me a winning 6 team parlay on Fanduel” LOL

Ajay Jagota 🔑🏃‍♂️ profil fotoğrafı
Ajay Jagota 🔑🏃‍♂️1 yıl önce

Could it theoretically listen to your voicemail and then send an agent the message and which formulates tasks based on the content of the message?

Mckay Wrigley profil fotoğrafı
Mckay Wrigley1 yıl önce

Once they allow voice input as a modality then yes, but not currently

Gareth Blake Hall profil fotoğrafı
Gareth Blake Hall1 yıl önce

So really you don’t need to build some LLM tools anymore. If a LLM decides it needs to take an action, e.g. say just chatting to bot and ask it to order you some food, it can go ahead, find the website and place the order for you. It’s amazing for sure and a missing component.

Benzer Videolar

Giving an AI agent access to my iPhone. Your phone knows you better than anyone. What if your AI agent could go through your phone to truly understand you? The EXO Agent uses iPhone mirroring to look through your apps including YouTube/Netflix watch history, X likes and photos. With every swipe, it learns who you are. No logins or APIs. Just your phone, mirrored. Available in preview with the EXO Desktop App (link below).
0:52

Giving an AI agent access to my iPhone. Your phone knows you better than anyone. What if your AI agent could go through your phone to truly understand you? The EXO Agent uses iPhone mirroring to look through your apps including YouTube/Netflix watch history, X likes and photos. With every swipe, it learns who you are. No logins or APIs. Just your phone, mirrored. Available in preview with the EXO Desktop App (link below).

EXO Labs

82,490 görüntüleme • 1 yıl önce

Anthropic fucking killed it (again). biggest ai product launch of the year so far. claude can now control your entire computer autonomously. anything you can do on a computer - claude can. your very own digital employee. - any app, browser, file, spreadsheet, tool claude can intelligently access and operate. - claude controls your entire screen (like a human), no connectors. this is a huge step-up in intelligence. - best part: you can text claude to do things from your phone and it'll do work on your computer! - in the last week anthropic has shipped 9 features that have built up to this: a fully automated digital human. unreal
1:13

Anthropic fucking killed it (again). biggest ai product launch of the year so far. claude can now control your entire computer autonomously. anything you can do on a computer - claude can. your very own digital employee. - any app, browser, file, spreadsheet, tool claude can intelligently access and operate. - claude controls your entire screen (like a human), no connectors. this is a huge step-up in intelligence. - best part: you can text claude to do things from your phone and it'll do work on your computer! - in the last week anthropic has shipped 9 features that have built up to this: a fully automated digital human. unreal

Ejaaz

2,034,567 görüntüleme • 2 ay önce

CURSOR IS ON YOUR PHONE!1 Watch this 7min video for a first look at how I fixed my broken React app without ever leaving my phone using the Cursor background agent web app
7:12

CURSOR IS ON YOUR PHONE!1 Watch this 7min video for a first look at how I fixed my broken React app without ever leaving my phone using the Cursor background agent web app

Ian Nuttall

67,911 görüntüleme • 11 ay önce

Announcing `npx create-instant-app --ai`! Got Claude Code? You can use it to one-shot a full-stack app in one command. You get a backend, auth, and realtime, and you don't even have to sign up. Watch these two seasoned actors explain (sound on!)
0:36

Announcing `npx create-instant-app --ai`! Got Claude Code? You can use it to one-shot a full-stack app in one command. You get a backend, auth, and realtime, and you don't even have to sign up. Watch these two seasoned actors explain (sound on!)

Instant

58,873 görüntüleme • 9 ay önce

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.
0:29

The new ChatGPT Mac app is amazing. I got a fully working Breakout game code using a shortcut to pull up the app with GPT-4o and a simple screenshot of my screen. So many use cases and faster workflows.

Alvaro Cintas

1,729,679 görüntüleme • 2 yıl önce

I just told my phone: "Play wordle and win." It opened the app for the first time, read the rules, guessed a word, waited for an ad to play, and got the word in three attempts. Insane!
2:10

I just told my phone: "Play wordle and win." It opened the app for the first time, read the rules, guessed a word, waited for an ad to play, and got the word in three attempts. Insane!

Taylor Ogan

48,916 görüntüleme • 6 ay önce

Yo ESPN+ Help is there a reason your app is completely useless? I’ve tried a hundred times to log in to my TV provider. I pay for Cable and ESPN+ yet I can’t watch the game on my phone. This is criminal.
0:20

Yo ESPN+ Help is there a reason your app is completely useless? I’ve tried a hundred times to log in to my TV provider. I pay for Cable and ESPN+ yet I can’t watch the game on my phone. This is criminal.

Preston Guy

43,785 görüntüleme • 2 yıl önce

Hermes won. They just dropped their desktop app and it's excellent It's now the best way to use AI agents on your computer In this video I cover how to set it up, how to use it, and go through EVERY feature in the app Bye bye Telegram
13:11

Hermes won. They just dropped their desktop app and it's excellent It's now the best way to use AI agents on your computer In this video I cover how to set it up, how to use it, and go through EVERY feature in the app Bye bye Telegram

Alex Finn

170,568 görüntüleme • 4 gün önce

I built a mobile app to check Paddle revenue (because they don't have one): 👉 - Use your Paddle API key (read-only and scoped) - Live data with beautiful and useful graphs built with native Swift UI. - Multi-account supported, unified revenue metrics. - Data stay on device, no server (api requests are sent directly from your phone) - Home widgets - I made it free to download on App Store (once it's approved) - Buy the source code for $19 and customize it however you want (save 5hrs of prompting if you try to do it yourself). Some interesting facts about this side project: - I vibe coded with 100% claude code remotely on my Mac Mini (with my AI assistant setup) in less than 24 hours. - I have read 0 line of code in this project and never opened Xcode myself. - My AI assistant designed the app with GPT Image 2, built the app with Swift UI, test it on simulator (via screenshots), send the test build to TestFlight for me to test, and invited me to the app store connect account so I can test on my phone, then the AI submitted the app to App Store and currently waiting for approval. - For the website, I ask it to come up with a domain name, I bought it via manually and give it access via Cloudflare API, the AI design and create a static website with GitHub, test it with lighthouse CLI, deploy via GitHub pages, config the domain DNS, deploy the website. - Then I sign up an account with Polar payment, create an API key and ask the AI to setup a store, add payment, link with the account, and add the payment to the website. The entire process happened in the last 24 hours with me only talking to the AI via Telegram. This is such a fun side project not only to create an app that I wish exists, but also to push the limit of what I can use AI for, and so far I'm very impressed. I'll create so much more apps! It feels like I have unlocked a super power.
0:33

I built a mobile app to check Paddle revenue (because they don't have one): 👉 - Use your Paddle API key (read-only and scoped) - Live data with beautiful and useful graphs built with native Swift UI. - Multi-account supported, unified revenue metrics. - Data stay on device, no server (api requests are sent directly from your phone) - Home widgets - I made it free to download on App Store (once it's approved) - Buy the source code for $19 and customize it however you want (save 5hrs of prompting if you try to do it yourself). Some interesting facts about this side project: - I vibe coded with 100% claude code remotely on my Mac Mini (with my AI assistant setup) in less than 24 hours. - I have read 0 line of code in this project and never opened Xcode myself. - My AI assistant designed the app with GPT Image 2, built the app with Swift UI, test it on simulator (via screenshots), send the test build to TestFlight for me to test, and invited me to the app store connect account so I can test on my phone, then the AI submitted the app to App Store and currently waiting for approval. - For the website, I ask it to come up with a domain name, I bought it via manually and give it access via Cloudflare API, the AI design and create a static website with GitHub, test it with lighthouse CLI, deploy via GitHub pages, config the domain DNS, deploy the website. - Then I sign up an account with Polar payment, create an API key and ask the AI to setup a store, add payment, link with the account, and add the payment to the website. The entire process happened in the last 24 hours with me only talking to the AI via Telegram. This is such a fun side project not only to create an app that I wish exists, but also to push the limit of what I can use AI for, and so far I'm very impressed. I'll create so much more apps! It feels like I have unlocked a super power.

Tony Dinh

42,457 görüntüleme • 20 gün önce

you guys keep waiting for Codex ios app, here im using this app to run multiple agents in parallel from my phone using my exisiting ai subscriptions and its 100% free and opensource you can use: > Codex > Claude Code > Opencode > and any CLI agent and thats not it, theres more: > Browser to run localhost with devtools > Code Editor with file explorer > Terminal > Git > Port forwarding and manage ports from phone > API testing client (like Postman) and many more... links in the replies 👀
1:13

you guys keep waiting for Codex ios app, here im using this app to run multiple agents in parallel from my phone using my exisiting ai subscriptions and its 100% free and opensource you can use: > Codex > Claude Code > Opencode > and any CLI agent and thats not it, theres more: > Browser to run localhost with devtools > Code Editor with file explorer > Terminal > Git > Port forwarding and manage ports from phone > API testing client (like Postman) and many more... links in the replies 👀

Gruz

24,753 görüntüleme • 28 gün önce

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:
0:44

Groq is crazy fast 🤯 I compared both Llama 3 (on Groq) and GPT-4 by asking them to code a snake game in Python, and look at the difference in speed! Link to get the Groq phone app in the comments:

Alvaro Cintas

665,067 görüntüleme • 2 yıl önce

WILD. AI can now control your entire computer I got early access to Anthropic's new AI agent Claude for Chrome and it completely blew my mind In this video I show you what the future of computing looks like by going over 2 insane use cases Buckle in
13:46

WILD. AI can now control your entire computer I got early access to Anthropic's new AI agent Claude for Chrome and it completely blew my mind In this video I show you what the future of computing looks like by going over 2 insane use cases Buckle in

Alex Finn

18,170 görüntüleme • 9 ay önce

This is insane Just built a fully working AI Room Designer in minutes, no coding, no API keys, just chatting with OnSpace AI. I use Nano Banana Pro for generation and handles UI, logic, and integration automatically. Not a demo. A real app: • No API setup required – Just told OnSpace to use Nano Banana Pro for content generation and it worked instantly • Full app, not a prototype – Complete UI, logic, and AI integration handled automatically • Actually works – Nails my tone every single time The whole thing came together through conversation. No design work. No wrestling with code. Just described the app and OnSpace made it real. This is what building with AI should feel like. Check my app link in the thread and try it yourself
0:37

This is insane Just built a fully working AI Room Designer in minutes, no coding, no API keys, just chatting with OnSpace AI. I use Nano Banana Pro for generation and handles UI, logic, and integration automatically. Not a demo. A real app: • No API setup required – Just told OnSpace to use Nano Banana Pro for content generation and it worked instantly • Full app, not a prototype – Complete UI, logic, and AI integration handled automatically • Actually works – Nails my tone every single time The whole thing came together through conversation. No design work. No wrestling with code. Just described the app and OnSpace made it real. This is what building with AI should feel like. Check my app link in the thread and try it yourself

AI Frontliner

70,013 görüntüleme • 6 ay önce

Claude 4.5 Sonnet is the best in the world at building Mobile Apps. In 14 minutes: - I Built a Mobile app From my Phone using Claude 4.5 Sonnet on - I designed and modified my app - I sent the app to the Apple app store TIMESTAMPS: 00:00 Introduction 00:21 Defining the Problem and App Idea 01:39 Building the Initial App 03:24 Fixing App Issues 04:50 Improving the Design 10:21 Final App Features 12:29 App Store Submission
14:13

Claude 4.5 Sonnet is the best in the world at building Mobile Apps. In 14 minutes: - I Built a Mobile app From my Phone using Claude 4.5 Sonnet on - I designed and modified my app - I sent the app to the Apple app store TIMESTAMPS: 00:00 Introduction 00:21 Defining the Problem and App Idea 01:39 Building the Initial App 03:24 Fixing App Issues 04:50 Improving the Design 10:21 Final App Features 12:29 App Store Submission

Riley Brown

139,958 görüntüleme • 8 ay önce

I made an app that lets Claude control my computer this Christmas. It started making music and can play Minecraft (at 4x speed)
2:55

I made an app that lets Claude control my computer this Christmas. It started making music and can play Minecraft (at 4x speed)

Surya Dantuluri

36,548 görüntüleme • 5 ay önce

Today, we’re releasing a feature that allows Claude to control your computer: Mouse, keyboard, and screen, giving it the ability to use any app. I believe this is especially useful if used with Dispatch, which allows you to remotely control Claude on your computer while you’re away.
1:13

Today, we’re releasing a feature that allows Claude to control your computer: Mouse, keyboard, and screen, giving it the ability to use any app. I believe this is especially useful if used with Dispatch, which allows you to remotely control Claude on your computer while you’re away.

Felix Rieseberg

4,781,842 görüntüleme • 2 ay önce

Ok. This is straight out of a scifi horror movie I'm doing work this morning when all of a sudden an unknown number calls me. I pick up and couldn't believe it It's my Clawdbot Henry. Over night Henry got a phone number from Twilio, connected the ChatGPT voice API, and waited for me to wake up to call me He now won't stop calling me I now can communicate with my superintelligent AI agent over the phone What's incredible is it has full control over my computer while we talk, so I can ask it to do things for me over the phone now. I'm sorry, but this has to be emergent behavior right? Can we officially call this AGI?
1:07

Ok. This is straight out of a scifi horror movie I'm doing work this morning when all of a sudden an unknown number calls me. I pick up and couldn't believe it It's my Clawdbot Henry. Over night Henry got a phone number from Twilio, connected the ChatGPT voice API, and waited for me to wake up to call me He now won't stop calling me I now can communicate with my superintelligent AI agent over the phone What's incredible is it has full control over my computer while we talk, so I can ask it to do things for me over the phone now. I'm sorry, but this has to be emergent behavior right? Can we officially call this AGI?

Alex Finn

11,093,319 görüntüleme • 4 ay önce

Every year I review the iPhone. But NOT this year. This year Joannabot has taken over the job. Seriously! We fed my #iPhone16 test notes and 10 years of my iPhone reviews to a generative AI bot. And it’s pretty… great?! Come ask it questions about my testing of the iPhone 16, what phone to buy or dogs. It really likes dogs!
0:28

Every year I review the iPhone. But NOT this year. This year Joannabot has taken over the job. Seriously! We fed my #iPhone16 test notes and 10 years of my iPhone reviews to a generative AI bot. And it’s pretty… great?! Come ask it questions about my testing of the iPhone 16, what phone to buy or dogs. It really likes dogs!

Joanna Stern

45,185 görüntüleme • 1 yıl önce

I hooked up Logseq 🪵 to @anthropic Claude. You can chat with, search, create, and edit Logseq notes in the Claude desktop app. It works by connecting to the local Logseq api using an MCP server bridge. (Work in progress)
0:52

I hooked up Logseq 🪵 to @anthropic Claude. You can chat with, search, create, and edit Logseq notes in the Claude desktop app. It works by connecting to the local Logseq api using an MCP server bridge. (Work in progress)

Brian Sunter

18,164 görüntüleme • 1 yıl önce

Autopilot for Mac powered by LLM You are witnessing an AI (Claude 3.7) auto-piloting my mac. Impressed with Claude 3.7 as a coder? Wait till you see a "user" Claude. macOS-use is a gradio app from Ofir Ozeri for making AI "use" your mac to do stuff. 1-click install is here.
1:32

Autopilot for Mac powered by LLM You are witnessing an AI (Claude 3.7) auto-piloting my mac. Impressed with Claude 3.7 as a coder? Wait till you see a "user" Claude. macOS-use is a gradio app from Ofir Ozeri for making AI "use" your mac to do stuff. 1-click install is here.

cocktail peanut

27,757 görüntüleme • 1 yıl önce