Developer Antirez criticizes Anthropic over aggressive web scraping practices
Is this a scandal?
Not yet — early signal: noise 45/100 · state: Emerging · 3 source items across 2 platforms · peaked at 50/100 on Jun 11, 2026. — as of , measured by the SCAND.Ai noise pipeline.
Incident ID: SCAND-157123
Cite this incident
"Developer Antirez criticizes Anthropic over aggressive web scraping practices." SCAND.Ai incident SCAND-157123, noise 45/100 as of June 11, 2026. https://scand.ai/scandal/antirez-criticizes-anthropic-scrapingWhy It Matters
The public callout highlights growing friction between independent web developers and AI labs over data harvesting consent and crawler behavior. This tension could accelerate the adoption of stricter web standards or legal barriers against AI training crawlers.
Key Points
- Redis creator Salvatore Sanfilippo (Antirez) publicly condemned Anthropic's data harvesting and web operations.
- Web developers have increasingly criticized Anthropic's ClaudeBot for aggressive scraping that consumes significant server bandwidth.
- Anthropic maintains that it respects robots.txt opt-out signals, but critics argue the default 'opt-out' paradigm is fundamentally unfair to creators.
Salvatore Sanfilippo, the creator of Redis known online as Antirez, has publicly criticized AI startup Anthropic, stating that the company's current practices are "deeply wrong." While the initial social media posts did not detail every specific grievance, the criticism aligns with widespread developer frustration over Anthropic's web crawler, ClaudeBot, which webmasters accuse of aggressively scraping content while bypassing standard polite crawling protocols. Anthropic has previously defended its data collection methods as compliant with standard opt-out web protocols, but has faced escalating backlash from the independent web community over the scale and frequency of its harvesting operations.
Salvatore Sanfilippo, the legendary programmer who built Redis, just called out Anthropic on social media, saying what they are doing is deeply wrong. He is likely talking about ClaudeBot, Anthropic's web crawler, which has been driving web developers crazy by aggressively scraping sites for AI training data. It is like an uninvited guest raiding your fridge and ignoring your house rules. This high-profile complaint shows how fed up independent creators are getting with big AI labs taking their data.
Sides
Critics
Asserts that Anthropic's current web operations and data harvesting practices are deeply wrong.
Defenders
Defends its data collection and crawling practices as compliant with standard opt-out web protocols.
Noise Level
Forecast
Anthropic will likely face increased pressure to refine ClaudeBot's crawling rate limits and public relations outreach to developers. More independent websites are expected to implement hard blocks against Anthropic IP ranges to protect their bandwidth and intellectual property.
Based on current signals. Events may develop differently.
Timeline
Antirez criticizes Anthropic on X
Salvatore Sanfilippo posts a strong condemnation of Anthropic's behavior, sparking widespread discussion on Hacker News.
Join the Discussion
Discuss this story
Community comments coming in a future update
Be the first to share your perspective. Subscribe to comment.