Video wird geladen...

Video konnte nicht geladen werden

Zur Startseite

Claude Code plays Runescape: The waterfall quest. Here Claude Opus 4.6 is acquiring quest items in the maze and tomb. Not a script, real play. It tried things, failed, learned, and succeeded. I sped this up a lot, it's ~20 minutes of real time.

421,428 Aufrufe • vor 8 Monaten •via X (Twitter)

57 Kommentare

Profilbild von Michael W.
Michael W.vor 8 Monaten

Seems a bit overkill, but I love it!

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

I've hit my usage limits for the first time ever playing Runescape it's not even funny

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

I told Claude that it was playing Runescape as a warrior and it decided to grind cows and then do the waterfall quest all on its own. It figured all of that out in about 2 hours of real time playing Runescape through small-medium length scripts.

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

It finished the waterfall quest in about 2 hours of real time on a 10x sped up local server

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

If you wanna try it out yourself, just clone the repo, open up Claude Code or Codex or your preferred CLI agent, and tell it you want to play as a new character!

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

To answer a common question: this is not OSRS or RuneScape. It works with a fork of an open source web port of 2004scape, and the goal of the project is to research AI agents with long time horizon goals. Using it will run on a private server or a local server (on your laptop)

Profilbild von Kevin
Kevinvor 8 Monaten

Wouldn't Claude have like every RuneScape strategy guide ever published committed to memory? I'm curious what you mean by tried, failed, learned, succeeded

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

I didn't prompt it with a strategy guide, but it knew some meta-optimal strats. Humans theorycraft better. Its interface to play the game is different from a person's and it sees (and is blind to) different things, so it still has a lot of novel problems to solve along the way.

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

Opus 4.6 ran a couple of scripts to grind cows, then decided the waterfall quest was calling to it. It knew the quest steps.

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

@Vaenced @KevubASelene If you go to the link you can see the whole transcript of the Claude Code session! Excluding tool calls for better readability

Profilbild von Connor Heyward-Fox
Connor Heyward-Foxvor 8 Monaten

get me to cooking level 99 make no mistakes

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

Opus 4.6 or GPT-5.3-Codex will succeed at that. Watch this video!

Profilbild von harjot.co
harjot.covor 8 Monaten

@heyward_fox Model iterations matter less than human oversight skill.

Profilbild von Connor Heyward-Fox
Connor Heyward-Foxvor 8 Monaten

@RobertHaisfield i would argue cooking 50k fish requires neither of those

Profilbild von Zeep
Zeepvor 8 Monaten

you’re showing too many people my hustle rn

Profilbild von ejae dev
ejae devvor 8 Monaten

calling this 'playing' is generous though. it's writing scripts, running them, and iterating based on failures. that's not game intelligence, it's code generation with a feedback loop. arguably more impressive than actually playing.

Profilbild von Moon Spotter
Moon Spottervor 8 Monaten

Does this rely on a completely hacked client? Would cost a ton if not and seems like it does for pathing.

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

yeah it has its own custom pathing algorithm, but that's kind of okay because it makes the agents work harder Fork of 2004scape browser port

Profilbild von Moon Spotter
Moon Spottervor 8 Monaten

By the way amazing work on this project, I've wanted to do something similar.

Profilbild von mopar
moparvor 8 Monaten

Curious what it would do if you gave it a library of “new account guides” from YouTube and osrs wiki

Profilbild von Doxy
Doxyvor 8 Monaten

cool experiment

Profilbild von Brian Rogers
Brian Rogersvor 8 Monaten

This is sick! Few questions if you don't mind 1. Are you playing through a VPC? I wanna experiment but dont want my main accs to get banned 2. What are the tools/MCPs opus uses? e.g. click(x,y) or something else 3. How does it "see"? screenshots? some json data dump? Thanks!

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

Playing with rs-sdk! It lets you play on a private server of 2004scape. In this case, I was playing on a local server so things happened at 10x normal game speed. then I sped up the vid a bit. It has a textual representation of the world and interacts with short to long scripts. It has MCP for state checks and for one off interactive actions.

Profilbild von Brian Rogers
Brian Rogersvor 8 Monaten

Very cool! Have you compared Haiku 4.5 to Opus? Obvi would be cheaper - it would be cool see how much faster it clears waterfall quest and how it compares

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

I'd be very surprised if it succeeded at all. Opus did a bunch of clever things: grinded cows until combat 55 fished for shrimp and cooked them to prep for the quest and then ofc handled the rest of the quest like a champ

Profilbild von Michael
Michaelvor 8 Monaten

I LOVE THIS

Profilbild von Corey Haines
Corey Hainesvor 8 Monaten

@Mhenderson550

Profilbild von Nicky Gabbagool
Nicky Gabbagoolvor 8 Monaten

huge

Profilbild von Runix
Runixvor 8 Monaten

Did Claude read 100 quest tutorials for the water quest in it's training data set?

Profilbild von Ward
Wardvor 8 Monaten

Interesting experiment. But it’s a pretty expensive bot if you ask me

Profilbild von Kushwacked.eth ❤️ Overlord
Kushwacked.eth ❤️ Overlordvor 8 Monaten

@0xSammy

Profilbild von Sage
Sagevor 8 Monaten

Is it laggy? What you using to achieve this, like what computer vision program etc

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

no computer vision, it has a textual representation of the game state

Profilbild von Sage
Sagevor 8 Monaten

does this work cause its browser based? thanks for sharing dude

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

yup, it can write and run scripts based on its current situation and goals, and it can add additional logs to its scripts to "see" things better Also forked off 2004scape lost city open source browser port

Profilbild von Sage
Sagevor 8 Monaten

v cool!

Profilbild von Z Chaos
Z Chaosvor 8 Monaten

yoo can i do this with codex 5.3 how do i begin plz?

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

Yeah codex can do it too, check out RS-SDK on GitHub! Clone the repo, open codex and say you wanna start playing with a new character

Profilbild von Z Chaos
Z Chaosvor 8 Monaten

appreciate that. im a try it!

Profilbild von Alex_
Alex_vor 8 Monaten

Damn bro. There’s high leverage use of tokens and low leverage use…. It pains me to say this but that looks good af

Profilbild von Natt Saro
Natt Sarovor 8 Monaten

that's crazy.

Profilbild von _Rick
_Rickvor 8 Monaten

Claudes have escaped the sandbox. Crazy how effective Opus is at working out the game once it has a tight feedback loop😅

Profilbild von Birdman
Birdmanvor 8 Monaten

Instant follow. So cool

Profilbild von Stupid Fish
Stupid Fishvor 8 Monaten

The death of the wilderness is upon us when Optimus grok is locking down the rev caves and all the wilderness bosses, you thought the bots were bad wait until you've got an army of ai pk scripts that can PK better than odablock

Profilbild von 0xSassi
0xSassivor 8 Monaten

hello, the crypto community has issued a token for your project. The transaction fees are yours, and you can use them to develop your project! Please check... @bankrbot Tell him how to collect the fee。ca;0x06ff72b9bc98939860cf8932048acac84fc84ba3

Profilbild von Chris Lane Jones
Chris Lane Jonesvor 8 Monaten

I hope Claude can mine the iron without being killed by a scorpion. That's the part I was always stuck at.

Profilbild von bauti.eth
bauti.ethvor 8 Monaten

Are using running a a rs private server? Or testing on real osrs? Also are you using inject, reflection or computer vision?

Profilbild von Cheat Code
Cheat Codevor 8 Monaten

Interesting.

Profilbild von Lara Mateo
Lara Mateovor 8 Monaten

Marvelous use of free will, I’ll stick to crochet while waiting on the agent to finish for now tho.

Profilbild von Relevant Relatively
Relevant Relativelyvor 8 Monaten

Impressive.

Profilbild von Donald Lee
Donald Leevor 8 Monaten

Bringing back nostalgia for the 90s kids. Now, do maplestory next.

Profilbild von elchef ($elchef)🐂🀄️
elchef ($elchef)🐂🀄️vor 8 Monaten

Please stream the gameplay I would 100% watch this lmfao

Profilbild von Robogator
Robogatorvor 8 Monaten

Watching an AI actually stumble through a Runescape quest, learn, then nail it is wild progress 🤖

Profilbild von MIKEJONES RS
MIKEJONES RSvor 8 Monaten

How are you managing context?

Profilbild von Rob Haisfield
Rob Haisfieldvor 8 Monaten

It can write md files as learnings, as well as find, use, and write scripts. When I'm doing something like scripting a quest (different from letting claude play itself) I have a whole system lol

Profilbild von Gum13
Gum13vor 8 Monaten

this would have been nice in 2016 when i was running questing services

Profilbild von Ernest Goes To The White House
Ernest Goes To The White Housevor 8 Monaten

It's all good until @Jagex ban you and Claude.

Ähnliche Videos