The Dawn of GUI Agent A Preliminary Case Study with Claude 3.5 Computer Use Game (Honkai: Star Rail) Claude 3.5 Computer Use can help complete Honkai: Star Rail daily tasks, accurately locating and interacting with in-game elements.

discuss:

github:

For the low low price of 50 dollars each run

Claude 3.5 computer use may be good for point and click, but still no VLM can play non-awful moves in tic tac toe. I hope none of your tasks require thinking one or two moves ahead!

When the AI has better luck at character pulls 😭

@LernerBenjamin

Awesome!

cc: @soumikRakshit96 context: We have been trying to play Divine: Original Sin 2 with LLMs.

wow!

why does it have to be a stereotypical anime female?