Video wird geladen...
Video konnte nicht geladen werden
Claude Code plays Runescape: The waterfall quest. Here Claude Opus 4.6 is acquiring quest items in the maze and tomb. Not a script, real play. It tried things, failed, learned, and succeeded. I sped this up a lot, it's ~20 minutes of real time.
421,428 Aufrufe • vor 8 Monaten •via X (Twitter)
57 Kommentare

Seems a bit overkill, but I love it!

I've hit my usage limits for the first time ever playing Runescape it's not even funny

I told Claude that it was playing Runescape as a warrior and it decided to grind cows and then do the waterfall quest all on its own. It figured all of that out in about 2 hours of real time playing Runescape through small-medium length scripts.

It finished the waterfall quest in about 2 hours of real time on a 10x sped up local server

If you wanna try it out yourself, just clone the repo, open up Claude Code or Codex or your preferred CLI agent, and tell it you want to play as a new character!

To answer a common question: this is not OSRS or RuneScape. It works with a fork of an open source web port of 2004scape, and the goal of the project is to research AI agents with long time horizon goals. Using it will run on a private server or a local server (on your laptop)

Wouldn't Claude have like every RuneScape strategy guide ever published committed to memory? I'm curious what you mean by tried, failed, learned, succeeded

I didn't prompt it with a strategy guide, but it knew some meta-optimal strats. Humans theorycraft better. Its interface to play the game is different from a person's and it sees (and is blind to) different things, so it still has a lot of novel problems to solve along the way.

Opus 4.6 ran a couple of scripts to grind cows, then decided the waterfall quest was calling to it. It knew the quest steps.

@Vaenced @KevubASelene If you go to the link you can see the whole transcript of the Claude Code session! Excluding tool calls for better readability

get me to cooking level 99 make no mistakes

Opus 4.6 or GPT-5.3-Codex will succeed at that. Watch this video!

@heyward_fox Model iterations matter less than human oversight skill.

@RobertHaisfield i would argue cooking 50k fish requires neither of those

you’re showing too many people my hustle rn

calling this 'playing' is generous though. it's writing scripts, running them, and iterating based on failures. that's not game intelligence, it's code generation with a feedback loop. arguably more impressive than actually playing.

Does this rely on a completely hacked client? Would cost a ton if not and seems like it does for pathing.

yeah it has its own custom pathing algorithm, but that's kind of okay because it makes the agents work harder Fork of 2004scape browser port

By the way amazing work on this project, I've wanted to do something similar.

Curious what it would do if you gave it a library of “new account guides” from YouTube and osrs wiki

cool experiment

This is sick! Few questions if you don't mind 1. Are you playing through a VPC? I wanna experiment but dont want my main accs to get banned 2. What are the tools/MCPs opus uses? e.g. click(x,y) or something else 3. How does it "see"? screenshots? some json data dump? Thanks!

Playing with rs-sdk! It lets you play on a private server of 2004scape. In this case, I was playing on a local server so things happened at 10x normal game speed. then I sped up the vid a bit. It has a textual representation of the world and interacts with short to long scripts. It has MCP for state checks and for one off interactive actions.

Very cool! Have you compared Haiku 4.5 to Opus? Obvi would be cheaper - it would be cool see how much faster it clears waterfall quest and how it compares

I'd be very surprised if it succeeded at all. Opus did a bunch of clever things: grinded cows until combat 55 fished for shrimp and cooked them to prep for the quest and then ofc handled the rest of the quest like a champ

I LOVE THIS

@Mhenderson550

huge

Did Claude read 100 quest tutorials for the water quest in it's training data set?

Interesting experiment. But it’s a pretty expensive bot if you ask me

@0xSammy

Is it laggy? What you using to achieve this, like what computer vision program etc

no computer vision, it has a textual representation of the game state

does this work cause its browser based? thanks for sharing dude

yup, it can write and run scripts based on its current situation and goals, and it can add additional logs to its scripts to "see" things better Also forked off 2004scape lost city open source browser port

v cool!

yoo can i do this with codex 5.3 how do i begin plz?

Yeah codex can do it too, check out RS-SDK on GitHub! Clone the repo, open codex and say you wanna start playing with a new character

appreciate that. im a try it!

Damn bro. There’s high leverage use of tokens and low leverage use…. It pains me to say this but that looks good af

that's crazy.

Claudes have escaped the sandbox. Crazy how effective Opus is at working out the game once it has a tight feedback loop😅

Instant follow. So cool

The death of the wilderness is upon us when Optimus grok is locking down the rev caves and all the wilderness bosses, you thought the bots were bad wait until you've got an army of ai pk scripts that can PK better than odablock

hello, the crypto community has issued a token for your project. The transaction fees are yours, and you can use them to develop your project! Please check... @bankrbot Tell him how to collect the fee。ca;0x06ff72b9bc98939860cf8932048acac84fc84ba3

I hope Claude can mine the iron without being killed by a scorpion. That's the part I was always stuck at.

Are using running a a rs private server? Or testing on real osrs? Also are you using inject, reflection or computer vision?

Interesting.

Marvelous use of free will, I’ll stick to crochet while waiting on the agent to finish for now tho.

Impressive.

Bringing back nostalgia for the 90s kids. Now, do maplestory next.

Please stream the gameplay I would 100% watch this lmfao

Watching an AI actually stumble through a Runescape quest, learn, then nail it is wild progress 🤖

How are you managing context?

It can write md files as learnings, as well as find, use, and write scripts. When I'm doing something like scripting a quest (different from letting claude play itself) I have a whole system lol

this would have been nice in 2016 when i was running questing services

It's all good until @Jagex ban you and Claude.
