Загрузка видео...
Не удалось загрузить видео
Someone just shipped a Claude Code skill that uses Cloudflare’s new /crawl endpoint to scrape entire docs sites in one command. In the demo, it pulled 29 pages from the Claude docs in a single shot.
110,722 просмотров • 7 месяцев назад •via X (Twitter)
Комментарии: 35

Nobody's talking about what just happened here. An agent just gave itself full context of an entire docs site. One command. 29 pages. Done. Reading docs was the last thing slowing builders down. That gap just closed.

This is the perfect combo. Claude Code + /crawl endpoint = instant codebase context from any docs site. 29 pages in one shot is wild 🔥

29 pages in one shot means agents stop guessing at API behavior. been doing this by hand for months. does this make context prep fully automated or do edge cases still break it?

The interesting thing here isn't the scraping. it's what it unlocks. Claude Code with live access to any documentation site means the context it's working with doesn't have to be baked into the model anymore. you pull the latest docs on demand. that's a fundamentally different way to stay current

29 pages of docs in one shot is what makes RAG pipelines actually usable. the old pattern was chunking docs manually and hoping your embeddings held up. now you crawl, ingest, and query in a single skill. the dev tooling gap is closing faster than most teams are updating their workflows.

Instead of posting useless and shitty stuff, share real valuable contents for devs /crawl is just something that any devs can achieve using a simple curl, and they can do better using a nice tls avoiding bot protection Thanks

@grok give me the github link for this skill

That’s powerful. Pairing Claude Code with Cloudflare’s crawl endpoint basically gives agents one-command context ingestion for entire documentation sites huge for faster coding and debugging workflows. 🚀

That's insane mate

That’s actually wild… one command for an entire docs site is crazy.

Why don't we have some API docs that are actually documents easy to download

damn, that sounds like a game changer for devs 29 pages in one go? this is gonna save so much time

Agents are moving from answering to actually doing. That shift changes everything.

29 pages in one shot is wild, can't wait to see what else people build with this /crawl endpoint

we call this magic ai boom

interesting tool, but scraping isn’t solving fundamental problems.

my open claw set this up for me in 15 seconds without a third party skill

damn that's clean

Check it too by @xwickD

But wait — does it handle dynamic content / JS-rendered pages too?

Impressive throughput! Single-command doc scraping removes real friction for developers working with LLMs. The 29-page demo shows Cloudflare enabling practical AI workflows.

That's powerful

damn, that’s wild! talk about leveling up the dev game with just one command can’t wait to see what else u can do with it!

New tools, new adventures. Keep em coming

Good skill

"someone" lol -- why not post the link?

damn that sounds wild one command to scrape all that data is next level can't wait to see how this changes the game

the claude code skill ecosystem is starting to feel like npm for agent workflows honestly 😭 this plus a few others i run in kilo and it basically covers everything i wouldve built custom six months ago. single command installs are where agent tooling needs to be

That sounds like a game-changer for web scraping tasks! The new Cloudflare endpoint must be really powerful if it can handle something as resource-intensive as that many pages at once.

This is cool. It highlights how specific endpoints unlock new capabilities for AI to process information.

When Claude creates something immersive i.e. broadcasting ads or training into a three-dimensional space around someone—like floating holograms or AR overlays Or Claude designs content: scripts ad copy, generates 3D models or plans interactive training flows Then it goes 10 X

woah.. incredible

skills like this are popping up daily now. the missing piece is a place to discover them, version them, and know which ones actually perform well. we open sourced SkillNote for exactly this

This is a great primitive for agent tooling. Real win is deterministic crawl boundaries + rate control, so automation stays useful instead of noisy. Cloudflare docs for the endpoint:

Wish this had come out sooner. I had just spent a weekend hacking together a scrapper using residential proxies

