Video yรผkleniyor...
Video Yรผklenemedi
๐ช๐ฒ ๐ฎ๐ฟ๐ฒ ๐ฒ๐ ๐ฐ๐ถ๐๐ฒ๐ฑ ๐๐ผ ๐ผ๐ฝ๐ฒ๐ป-๐๐ผ๐๐ฟ๐ฐ๐ฒ ๐๐ต๐ฒ ๐ฆ๐ฒ๐น๐ณ-๐ข๐ฝ๐ฒ๐ฟ๐ฎ๐๐ถ๐ป๐ด ๐๐ผ๐บ๐ฝ๐๐๐ฒ๐ฟ ๐๐ฟ๐ฎ๐บ๐ฒ๐๐ผ๐ฟ๐ธ ๐๐ต๐ฎ๐ ๐ฒ๐ป๐ฎ๐ฏ๐น๐ฒ๐ ๐บ๐๐น๐๐ถ๐บ๐ผ๐ฑ๐ฎ๐น ๐บ๐ผ๐ฑ๐ฒ๐น๐, ๐ถ๐ป๐ฐ๐น๐๐ฑ๐ถ๐ป๐ด ๐๐ฃ๐ง-๐ฐ-๐ฉ๐ถ๐๐ถ๐ผ๐ป ๐๐ผ ๐๐ถ๐บ๐๐น๐ฎ๐๐ฒ ๐ต๐๐บ๐ฎ๐ป-๐น๐ถ๐ธ๐ฒ ๐บ๐ผ๐๐๐ฒ ๐ฐ๐น๐ถ๐ฐ๐ธ๐ ๐ฎ๐ป๐ฑ ๐ธ๐ฒ๐๐ฏ๐ผ๐ฎ๐ฟ๐ฑ ๐ถ๐ป๐ฝ๐๐๐ ๐ผ๐ป ๐ฎ ๐ฐ๐ผ๐บ๐ฝ๐๐๐ฒ๐ฟ. Based on a given objective, the model estimates the correct X & Y locations for mouse clicks and the appropriate keyboard inputs at... show more
2,079,350 gรถrรผntรผleme โข 2 yฤฑl รถnce โขvia X (Twitter)
10 Yorum

Finished an iteration to this project this morning that Iโm excited about. I hope to share more early in the new year.

Rolling waves of agent swarms are going to rock the internet to its core

this is amazing! really excited to play with this. I was trying to do this a couple days after GPT-4V was released but gave up after my testing inside ChatGPT asking it to name coordinates in the grid failed + a different project caught my interest. p.s - took this screenshot before sending the message to ChatGPT to initially test the grid thing with code interpreter๐

Greatest release towards AGI, great work, canโt wait to contribute

My API bills hurt watching this

love this. just for mac tho?

Yes at this time, it is open-source so if you want to add windows compatibility and make a PR thatโd be great!

You're very cool !! OpenAI's vision API did not allow for the specification of the x-axis and y-axis. How was this resolved?

> Note: The GPT-4v's error rate in estimating XY mouse click locations is currently quite high. Interesting. I might try do some automatic labelling on a screenshot, like my web agent: Might be more accurate. Did you try that already @josh_bickett ?

Slay
