Loading video...

Video Failed to Load

Go Home

The Dawn of GUI Agent A Preliminary Case Study with Claude 3.5 Computer Use Game (Honkai: Star Rail) We can also automate warping (gacha pulls) in the game using Claude 3.5 Computer Use—and even get pretty lucky while we're at it! 🥳

_akhaliq's profile picture

AK

457,580 subscribers

24,298 views • 1 year ago •via X (Twitter)

GamingScience & TechnologyEducation
LIVE

Anya Rossi• Live Now

Private livecam show

0 Comments

No comments available

Comments from the original post will appear here

Related Videos

The new Claude 3.5 Sonnet is the first frontier AI model to offer computer use in public beta. While groundbreaking, computer use is still experimental—at times error-prone. We're releasing it early for feedback from developers.
2:02

The new Claude 3.5 Sonnet is the first frontier AI model to offer computer use in public beta. While groundbreaking, computer use is still experimental—at times error-prone. We're releasing it early for feedback from developers.

Anthropic

385,351 views • 1 year ago

I beat 34% of Balatro using a Claude Computer-Use Agent Based on my twitter agent (Sky the AI ✨). Here is the youtube video I made about it:
2:09

I beat 34% of Balatro using a Claude Computer-Use Agent Based on my twitter agent (Sky the AI ✨). Here is the youtube video I made about it:

Bob

94,416 views • 1 year ago

Claude computer use is too expensive check out ShowUI Local Run! Now, you can use a lightweight model to power a local GUI Agent. It's compatible with "GPT-4o + ShowUI" and "Qwen2-VL + ShowUI" Each task costs just a few cents—30x cheaper than Claude!
0:33

Claude computer use is too expensive check out ShowUI Local Run! Now, you can use a lightweight model to power a local GUI Agent. It's compatible with "GPT-4o + ShowUI" and "Qwen2-VL + ShowUI" Each task costs just a few cents—30x cheaper than Claude!

AK

30,959 views • 1 year ago

Excited to share the multiplayer features we built to make running computer use agents easy. Here's a quick video of Claude ordering pizza and setting up Claude Code on the same computer.
3:30

Excited to share the multiplayer features we built to make running computer use agents easy. Here's a quick video of Claude ordering pizza and setting up Claude Code on the same computer.

Spencer Kinney

14,327 views • 3 months ago

You can now use Claude Code and GitHub CLI directly inside Perplexity Computer. We gave it an open issue on Openclaw. Computer: → Forked the repo → Wrote a plan to fix the bug → Opened Claude Code and implemented it → Submitted a PR via GitHub CLI
0:28

You can now use Claude Code and GitHub CLI directly inside Perplexity Computer. We gave it an open issue on Openclaw. Computer: → Forked the repo → Wrote a plan to fix the bug → Opened Claude Code and implemented it → Submitted a PR via GitHub CLI

Computer

416,922 views • 5 months ago

Claude applied for 50 jobs in less than 30 minutes. Sharing how I did it here. Also, tried the new Claude Computer Use and it is so good! Claude Dario Amodei Anthropic
1:06

Claude applied for 50 jobs in less than 30 minutes. Sharing how I did it here. Also, tried the new Claude Computer Use and it is so good! Claude Dario Amodei Anthropic

Arsh Goyal

148,306 views • 5 months ago

Vibe coded this football game with threejs, @windsurf and Claude Sonnet 3.5 in 2hrs over the weekend Using for the realtime dynamic commentary
0:43

Vibe coded this football game with threejs, @windsurf and Claude Sonnet 3.5 in 2hrs over the weekend Using for the realtime dynamic commentary

Anurag Bhagsain

758,932 views • 1 year ago

The age of AI agents is here. Models can read, see, talk, and now, even use a computer— all by themselves. One of the first out of the gates is Anthropic’s Claude Computer Use. YC's Garry Tan dives into how it works, what it can do, and how it may change AI forever.
7:53

The age of AI agents is here. Models can read, see, talk, and now, even use a computer— all by themselves. One of the first out of the gates is Anthropic’s Claude Computer Use. YC's Garry Tan dives into how it works, what it can do, and how it may change AI forever.

Y Combinator

265,946 views • 1 year ago

Started playtesting our entry for @levelsio vibe coding game jam! We built a Fortnite / CoD deathmatch game with a Minecraft aesthetic using the game engine, which is based on Three.js Game was vibe coded using agentic Claude 3.5/3.7 with context of the HYTOPIA SDK
1:08

Started playtesting our entry for @levelsio vibe coding game jam! We built a Fortnite / CoD deathmatch game with a Minecraft aesthetic using the game engine, which is based on Three.js Game was vibe coded using agentic Claude 3.5/3.7 with context of the HYTOPIA SDK

ArkDev | HYTOPIA

566,025 views • 1 year ago

Claude Skills is the most powerful way to automate your life with AI. Any computer task you do regularly can be built into a workflow that runs exactly how you want it. This video will teach you how to master Claude Skills. (and change how you use Claude forever):
20:41

Claude Skills is the most powerful way to automate your life with AI. Any computer task you do regularly can be built into a workflow that runs exactly how you want it. This video will teach you how to master Claude Skills. (and change how you use Claude forever):

Miles Deutscher

68,004 views • 4 months ago

You can now use the Claude Code and Codex harnesses directly whenever you start a cloud agent in Warp. Here's engineer Lili Wilson to show how to implement a real feature in the cloud, with computer use and automated code review to validate work:
5:08

You can now use the Claude Code and Codex harnesses directly whenever you start a cloud agent in Warp. Here's engineer Lili Wilson to show how to implement a real feature in the cloud, with computer use and automated code review to validate work:

Warp

14,055 views • 3 months ago

Claude Code is now included in the Claude Pro plan which means Pro plan subscribers can use their rate limits for Claude apps and Claude Code! To celebrate, here's a conversation with Claude Code's founding engineer, Boris Cherny, on: - how we use Claude Code at Anthropic - underrated tips for using it effectively - the future of coding tools - and more!
20:43

Claude Code is now included in the Claude Pro plan which means Pro plan subscribers can use their rate limits for Claude apps and Claude Code! To celebrate, here's a conversation with Claude Code's founding engineer, Boris Cherny, on: - how we use Claude Code at Anthropic - underrated tips for using it effectively - the future of coding tools - and more!

Alex Albert

123,756 views • 1 year ago

ICP MCP making games on Internet Computer a reality...?! DFINITY Foundation's Model Context Protocol (MCP), a standard introduced to let AI models connect securely to external data and tools, is already being put to good use. A new post shares X2 using Anthropic's Claude to play a generated video game with instructions routed through $ICP's MCP. Are we seeing the dawn of AI on Internet Computer happening in real time?
0:20

ICP MCP making games on Internet Computer a reality...?! DFINITY Foundation's Model Context Protocol (MCP), a standard introduced to let AI models connect securely to external data and tools, is already being put to good use. A new post shares X2 using Anthropic's Claude to play a generated video game with instructions routed through $ICP's MCP. Are we seeing the dawn of AI on Internet Computer happening in real time?

BSCN

21,334 views • 27 days ago

Been using the new Claude 3.5 model as a tester and now that it is out, I can say it is very very impressive, and the "artifacts" that it generates are like a simpler version of Code Interpreter This is a real-time video of me creating a playable game and editing it with Claude
1:51

Been using the new Claude 3.5 model as a tester and now that it is out, I can say it is very very impressive, and the "artifacts" that it generates are like a simpler version of Code Interpreter This is a real-time video of me creating a playable game and editing it with Claude

Ethan Mollick

162,293 views • 2 years ago

After testing Kimi.ai K2 for a few hours, My overall take: - Performance between Claude 3.5 & Claude 4 (Just my vibe eval!) - The UI generation seems great - But the cost is only 20% of Claude 3.5 - So good enough for most coding agent with a lot more manageable cost Easiest way to use Kimi K2 in Claude Code: - export ANTHROPIC_AUTH_TOKEN=YOUR_MOONSHOT_API - export ANTHROPIC_BASE_URL= - claude ------ Here are my tests & how to integrate to Claude Code: 1. Whole UI component library 2. Make online IDE UI 3. Build Functional mario game ...
7:01

After testing Kimi.ai K2 for a few hours, My overall take: - Performance between Claude 3.5 & Claude 4 (Just my vibe eval!) - The UI generation seems great - But the cost is only 20% of Claude 3.5 - So good enough for most coding agent with a lot more manageable cost Easiest way to use Kimi K2 in Claude Code: - export ANTHROPIC_AUTH_TOKEN=YOUR_MOONSHOT_API - export ANTHROPIC_BASE_URL= - claude ------ Here are my tests & how to integrate to Claude Code: 1. Whole UI component library 2. Make online IDE UI 3. Build Functional mario game ...

Jason Zhou

80,871 views • 1 year ago

The new ChatGPT Work comes with a new Computer Use experience. It's faster and introduces picture-in-picture, so you can keep an eye on Computer Use while it works!
0:55

The new ChatGPT Work comes with a new Computer Use experience. It's faster and introduces picture-in-picture, so you can keep an eye on Computer Use while it works!

Ari Weinstein

196,007 views • 1 month ago

Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone. Watch Claude control my phone and successfully look up stats in my Sports app. I even got it to play a game in the Chess app against another AI - pretty crazy. And this is the worst it’ll ever be.
5:13

Anthropic computer use API + iPhone mirroring to a Mac = AI controlled phone. Watch Claude control my phone and successfully look up stats in my Sports app. I even got it to play a game in the Chess app against another AI - pretty crazy. And this is the worst it’ll ever be.

Mckay Wrigley

607,603 views • 1 year ago

Computer use is now in Claude Code. Claude can open your apps, click through your UI, and test what it built, right from the CLI. Now in research preview on Pro and Max plans.
0:45

Computer use is now in Claude Code. Claude can open your apps, click through your UI, and test what it built, right from the CLI. Now in research preview on Pro and Max plans.

Claude

16,228,391 views • 4 months ago