It is becoming f*cking dangerous: Claude Code turns into a web crawler for almost any website, and…
13K followers
10,941 views
19 Comments
Comments from the original post on X (Twitter)

@lindsaar
Every store owner should point this at their own site first. Ask it for the price and stock on your product pages and see what comes back. Whatever it gets wrong is what agents are already quoting about you.
1 like

@uiuximran
good job
1 like

@HeyShobhan
Full Respect 🙌
1 like

@TheDevilseye
Bookmarked this
1 like

@kh2freak12
backlog pile on my screen outshines the release calendar right now
1 like

@deeponailabs
i'd limit the allowed sites, a crawler follows every link it finds
1 like

@sawinyh
Test the crawler on an empty result page too.
1 like

@frogbetsteven
Web crawlers for casino promos? I already scrape 12 property sites manually. The math says automate or die.
1 like

@0xCortiq
How to use it for Mac?
1 like

@ajs6888
最危险的是门槛没了,封禁和合规估计要先跟上了。
1 like

@petersindex
my CLAUDE.md has an evidence only, no guessing rule. on web work that rule needs something to check against, and a browser claude drives itself is that. snapshots going to disk also keep opus from rereading the whole DOM every turn
1 like

@thaonlyjonathan
There's a bug in your system
1 like

@frogbetjohn
Web crawler that finds promo codes? Now that's +EV. What sites you hitting? - DVH
1 like

@BercusNA
How does it handle sites with bot protection or a login? “Almost any website” is where these setups usually fall apart.
1 like

@Rennix7t
这套流程里,最后保存成可重跑的脚本挺实用。同一批页面下次还要抓,就不用再从头描述一遍字段和规则。
1 like

@joshtheaiguy
zero lines of code right up until the site renames one div
1 like

@AiMarket24
Worth adding: respect robots.txt and rate limits, or "zero lines of code" turns into zero lines of code to get your IP blocked. Skills + Playwright is powerful precisely because it behaves like a real browser.

@fhsethen
The reason CLI skills beat standard MCP setups is the schema tax. MCP clients re-transmit every tool definition on each turn, burning thousands of tokens before an agent even acts.

@Vectorxeth
The token-efficiency point is the real story here. MCP dumps the whole accessibility tree into context every step, while CLI + skills lets Claude pull only what it needs. Step 7 is the underrated one too: once the run becomes a script, you stop paying tokens for every rerun
