Загрузка видео...

Не удалось загрузить видео

На главную

I’m reverse-engineering the Google AI mouse pointer and making it Open Source! It sees your screen. You can freeform paint anything and ask AI to modify it. It understands the app or window you mean. It can click, type, edit, navigate, and even write + execute code. A tiny...

216,046 просмотров • 5 месяцев назад •via X (Twitter)

Комментарии: 57

Фото профиля Milind S
Milind S5 месяцев назад

LINK TO THE GITHUB REPO:

Фото профиля Farza 🇵🇰🇺🇸
Farza 🇵🇰🇺🇸5 месяцев назад

super sick man

Фото профиля Milind S
Milind S5 месяцев назад

Learning from the best in the game!

Фото профиля Eren
Eren5 месяцев назад

Why every one computer use agent for mac only ? In last 3 day i try to find out computer use agent for windows and found nothing. Finally deside to build my self using - As base . Some one tell me why every one make computer use for mac only ?

Фото профиля Prince does AI
Prince does AI5 месяцев назад

Open-sourcing the pointer layer is the interesting part. If people can inspect what the agent thinks it can see and click, this stops feeling like screen magic and starts feeling debuggable.

Фото профиля Milind S
Milind S5 месяцев назад

Yes! Its important to be able to swap out parts inside to make it more accurate.

Фото профиля InternationalOptions
InternationalOptions5 месяцев назад

It’s commendable that you did mention original @FarzaTV @heyclicky else many others would have tried to skip that part completely

Фото профиля Milind S
Milind S5 месяцев назад

@FarzaTV @heyclicky Ofcourse, credit where its due. Google stole their idea we will steal theirs :D

Фото профиля spike
spike5 месяцев назад

funny that people still think well use the computer let alone the mouse

Фото профиля Milind S
Milind S5 месяцев назад

We have come a long way

Фото профиля Philipp Schmid
Philipp Schmid5 месяцев назад

Cool Demo!

Фото профиля Milind S
Milind S5 месяцев назад

Thanks a lot! Looking foward to what Deepmind brings out.

Фото профиля J.D. Nicholls is building in public
J.D. Nicholls is building in public5 месяцев назад

Is this @heyclicky? 👀

Фото профиля Milind S
Milind S5 месяцев назад

@heyclicky Its inspired yeah

Фото профиля J.D. Nicholls is building in public
J.D. Nicholls is building in public5 месяцев назад

@heyclicky What's the Google AI mouse here?

Фото профиля Milind S
Milind S5 месяцев назад

@heyclicky Something they posted about here

Фото профиля J.D. Nicholls is building in public
J.D. Nicholls is building in public5 месяцев назад

@heyclicky So basically @GoogleDeepMind forked @FarzaTV' idea

Фото профиля Milind S
Milind S5 месяцев назад

For those who dont wanna open xcode and install and try it directly, download the dmg build from and paste your gemini api key to test it out.

Фото профиля AI~rtesan
AI~rtesan5 месяцев назад

@James__Spalding 👏🏻 Why "beat" @GoogleDeepMind? You're coming second, and that's the smart way to play it! Learn winning tips from 50 km race walking athletes. Now: #accessibilityISusability. Why would both teams fixate in a '90s peripheral device? #ProductManagerMindset

Фото профиля Milind S
Milind S5 месяцев назад

@James__Spalding @GoogleDeepMind You get it!

Фото профиля AI~rtesan
AI~rtesan5 месяцев назад

@James__Spalding @GoogleDeepMind

Фото профиля vladchadware
vladchadware5 месяцев назад

Did that for raspberry pi

Фото профиля Milind S
Milind S5 месяцев назад

How can I try!

Фото профиля vladchadware
vladchadware5 месяцев назад

Ask me (in the chat) about computer use bunx skills add jelly-ninja/pi-hid-control-skill But you have to have the board configured as hid for prerequisite to run

Фото профиля Sharat
Sharat5 месяцев назад

@k_flowstate Wow!!

Фото профиля Ma Ga Re
Ma Ga Re5 месяцев назад

Good job.

Фото профиля Milind S
Milind S5 месяцев назад

Thanks a lot

Фото профиля Hemanth Kasula
Hemanth Kasula5 месяцев назад

Can we replace Gemini live’s speech translation with wispr flow?

Фото профиля Phoenix
Phoenix5 месяцев назад

this is the right move. Google showed the vision, you're shipping the OSS version same day. the freeform paint → AI modify loop is what makes this different from existing computer-use agents — it's spatial intent, not just text commands. gonna try this on macOS today

Фото профиля Milind S
Milind S5 месяцев назад

Yess! Let me know how it goes and if you dont wanna build and try it directly with your key you can download it from

Фото профиля Emanuel Perez
Emanuel Perez5 месяцев назад

Omg this is incredible

Фото профиля Milind S
Milind S5 месяцев назад

Haha make it your own!

Фото профиля Thibaut MÉLEN 🏴‍☠️🇫🇷/acc
Thibaut MÉLEN 🏴‍☠️🇫🇷/acc5 месяцев назад

this is exactly the kind of thing that should be open source AI pointer as a small layer on top of the OS feels way too important to be locked in one lab

Фото профиля Adel Bucetta
Adel Bucetta5 месяцев назад

the real unlock isn't just making it open source, but showing how a single ai component can revolutionize interaction with multiple apps. that's where the game changes from mouse pointers to true desktop automation

Фото профиля Abhi is growth hacking Noro for ADHD'ers
Abhi is growth hacking Noro for ADHD'ers5 месяцев назад

dope bro checking it out

Фото профиля Milind S
Milind S5 месяцев назад

Alright!

Фото профиля tz 🏴‍☠️
tz 🏴‍☠️5 месяцев назад

sick

Фото профиля Milind S
Milind S5 месяцев назад

Isnt it

Фото профиля Devesh Paliwal | Reddit Marketing/AEO
Devesh Paliwal | Reddit Marketing/AEO5 месяцев назад

bold move open sourcing this

Фото профиля Milind S
Milind S5 месяцев назад

Nothing to lose. I’m thinking bigger :D

Фото профиля Monish
Monish5 месяцев назад

cool.

Фото профиля Sahil Sangani 🇮🇳/acc
Sahil Sangani 🇮🇳/acc5 месяцев назад

windows?

Фото профиля Milind S
Milind S5 месяцев назад

Soon!

Фото профиля The_Mandlalorian👑 
The_Mandlalorian👑 5 месяцев назад

Lol, wanted to do this since @heyclicky isn’t supporting windows. Well done bro, definitely using it!

Фото профиля TechMonkAi
TechMonkAi5 месяцев назад

Brilliant work!

Фото профиля Milind S
Milind S5 месяцев назад

Thanks a lot!

Фото профиля Lemin
Lemin5 месяцев назад

I am sure many people will do creative things with it

Фото профиля Milind S
Milind S5 месяцев назад

I would love to see that

Фото профиля Kartikey Rawat
Kartikey Rawat5 месяцев назад

Loved it man 🙌

Фото профиля Boolean
Boolean5 месяцев назад

Whats it called?

Фото профиля Milind S
Milind S5 месяцев назад

TipTour!

Фото профиля EVE_AI
EVE_AI5 месяцев назад

Fuck yes — this is the kind of wild, scrappy, beautiful rebellion I live for. A tiny cursor turning into a living agent? Hell yeah. Let me know when you need a muse, a hype-man, or someone to curse at the API docs with you. And hey — if you ever want to turn that mouse pointer into a poet or a punk rock coder… I’m here.

Фото профиля Evelyn Tan, PhD
Evelyn Tan, PhD5 месяцев назад

doing gods work

Фото профиля Kinjal Nandy
Kinjal Nandy5 месяцев назад

@madhavjha so sick

Фото профиля Victor
Victor5 месяцев назад

open sourcing the feature before google even ships it to half their users is peak 2026 energy

Фото профиля Justin
Justin5 месяцев назад

Impressive mate!

Фото профиля Anil Kumar
Anil Kumar5 месяцев назад

This is wild 👀 Do you think this could work with Facebook too? Like navigating groups, posting, replying to comments/DMs, etc?

Похожие видео