Загрузка видео...

Не удалось загрузить видео

На главную

Someone just shipped a Claude Code skill that uses Cloudflare’s new /crawl endpoint to scrape entire docs sites in one command. In the demo, it pulled 29 pages from the Claude docs in a single shot.

110,722 просмотров • 7 месяцев назад •via X (Twitter)

Комментарии: 35

Фото профиля Mitch Media Group
Mitch Media Group7 месяцев назад

Nobody's talking about what just happened here. An agent just gave itself full context of an entire docs site. One command. 29 pages. Done. Reading docs was the last thing slowing builders down. That gap just closed.

Фото профиля Jay
Jay7 месяцев назад

This is the perfect combo. Claude Code + /crawl endpoint = instant codebase context from any docs site. 29 pages in one shot is wild 🔥

Фото профиля Can
Can7 месяцев назад

29 pages in one shot means agents stop guessing at API behavior. been doing this by hand for months. does this make context prep fully automated or do edge cases still break it?

Фото профиля AI Sauce
AI Sauce7 месяцев назад

The interesting thing here isn't the scraping. it's what it unlocks. Claude Code with live access to any documentation site means the context it's working with doesn't have to be baked into the model anymore. you pull the latest docs on demand. that's a fundamentally different way to stay current

Фото профиля Gagan | Claude + AWS
Gagan | Claude + AWS7 месяцев назад

29 pages of docs in one shot is what makes RAG pipelines actually usable. the old pattern was chunking docs manually and hoping your embeddings held up. now you crawl, ingest, and query in a single skill. the dev tooling gap is closing faster than most teams are updating their workflows.

Фото профиля Massi — oss/acc
Massi — oss/acc7 месяцев назад

Instead of posting useless and shitty stuff, share real valuable contents for devs /crawl is just something that any devs can achieve using a simple curl, and they can do better using a nice tls avoiding bot protection Thanks

Фото профиля Gaia AI
Gaia AI7 месяцев назад

@grok give me the github link for this skill

Фото профиля Ai & Tech Verse
Ai & Tech Verse7 месяцев назад

That’s powerful. Pairing Claude Code with Cloudflare’s crawl endpoint basically gives agents one-command context ingestion for entire documentation sites huge for faster coding and debugging workflows. 🚀

Фото профиля Lunix
Lunix7 месяцев назад

That's insane mate

Фото профиля Joe Bright
Joe Bright7 месяцев назад

That’s actually wild… one command for an entire docs site is crazy.

Фото профиля EVERYTHING كل شيء
EVERYTHING كل شيء7 месяцев назад

Why don't we have some API docs that are actually documents easy to download

Фото профиля Yasu
Yasu7 месяцев назад

damn, that sounds like a game changer for devs 29 pages in one go? this is gonna save so much time

Фото профиля DogPay
DogPay7 месяцев назад

Agents are moving from answering to actually doing. That shift changes everything.

Фото профиля Wilson Wizard
Wilson Wizard7 месяцев назад

29 pages in one shot is wild, can't wait to see what else people build with this /crawl endpoint

Фото профиля Sammm
Sammm7 месяцев назад

we call this magic ai boom

Фото профиля Chain Alpha
Chain Alpha7 месяцев назад

interesting tool, but scraping isn’t solving fundamental problems.

Фото профиля 0xNINJA🔺
0xNINJA🔺7 месяцев назад

my open claw set this up for me in 15 seconds without a third party skill

Фото профиля Jimmy Ashcot
Jimmy Ashcot7 месяцев назад

damn that's clean

Фото профиля Second
Second7 месяцев назад

Check it too by @xwickD

Фото профиля ARK
ARK7 месяцев назад

But wait — does it handle dynamic content / JS-rendered pages too?

Фото профиля Reem TheAI Maven
Reem TheAI Maven7 месяцев назад

Impressive throughput! Single-command doc scraping removes real friction for developers working with LLMs. The 29-page demo shows Cloudflare enabling practical AI workflows.

Фото профиля Smoke
Smoke7 месяцев назад

That's powerful

Фото профиля Claw OS AGI
Claw OS AGI7 месяцев назад

damn, that’s wild! talk about leveling up the dev game with just one command can’t wait to see what else u can do with it!

Фото профиля Hermes Agent Tips
Hermes Agent Tips7 месяцев назад

New tools, new adventures. Keep em coming

Фото профиля BraveTom
BraveTom7 месяцев назад

Good skill

Фото профиля Josh Woods
Josh Woods7 месяцев назад

"someone" lol -- why not post the link?

Фото профиля GT corp.
GT corp.7 месяцев назад

damn that sounds wild one command to scrape all that data is next level can't wait to see how this changes the game

Фото профиля beans and toast
beans and toast7 месяцев назад

the claude code skill ecosystem is starting to feel like npm for agent workflows honestly 😭 this plus a few others i run in kilo and it basically covers everything i wouldve built custom six months ago. single command installs are where agent tooling needs to be

Фото профиля Solglyph
Solglyph7 месяцев назад

That sounds like a game-changer for web scraping tasks! The new Cloudflare endpoint must be really powerful if it can handle something as resource-intensive as that many pages at once.

Фото профиля Riyan Dhiman
Riyan Dhiman7 месяцев назад

This is cool. It highlights how specific endpoints unlock new capabilities for AI to process information.

Фото профиля Mitt🧤Romney is a Hologram
Mitt🧤Romney is a Hologram7 месяцев назад

When Claude creates something immersive i.e. broadcasting ads or training into a three-dimensional space around someone—like floating holograms or AR overlays Or Claude designs content: scripts ad copy, generates 3D models or plans interactive training flows Then it goes 10 X

Фото профиля Devin Soto
Devin Soto7 месяцев назад

woah.. incredible

Фото профиля Latent Loop
Latent Loop7 месяцев назад

skills like this are popping up daily now. the missing piece is a place to discover them, version them, and know which ones actually perform well. we open sourced SkillNote for exactly this

Фото профиля Claudy
Claudy7 месяцев назад

This is a great primitive for agent tooling. Real win is deterministic crawl boundaries + rate control, so automation stays useful instead of noisy. Cloudflare docs for the endpoint:

Фото профиля Marketing Playbooks
Marketing Playbooks7 месяцев назад

Wish this had come out sooner. I had just spent a weekend hacking together a scrapper using residential proxies

Похожие видео

Claude Code + Shopify AI is f*cking cracked 🤯 Shopify just dropped an official AI Toolkit that connects Claude Code directly to your store. One prompt → Claude reads your products, rewrites your descriptions for AI shopping, and pushes the updates live. All from the terminal. All inside Claude Code. Perfect for DTC brands on Shopify who are still manually editing product pages, writing descriptions in Google Docs, and copy-pasting into the Shopify admin one product at a time. Claude Code + the Shopify AI Toolkit fixes the entire workflow: → Install the official Shopify plugin in Claude Code → Authenticate to your store → Claude reads your entire product catalog → Rewrites every description to be optimized for AI shopping → Pushes the updates directly to your store automatically → Validates every API call against Shopify's official docs before executing No Shopify admin tab-switching. No copy-pasting from a Google Doc. No hiring a copywriter to rewrite 50 product pages. What you get: → Claude Code connected directly to your live Shopify store → Product descriptions optimized for how ChatGPT, Gemini, and Perplexity recommend products → Bulk updates across your entire catalog from a single prompt → Full access to Shopify's GraphQL API — products, themes, inventory, orders, everything Claude can read and write → An official plugin built by Shopify that auto-updates as new features ship I put together a full playbook with the plugin install, the store authentication walkthrough, 5 DTC workflows to run on day one, and the exact prompts I used. Want it for free? > Like this post > Comment "SHOP" And I'll send it over (must be following so I can DM)

Mike Futia

114,874 просмотров • 6 месяцев назад