ClaudeBot checker
Understand ClaudeBot access alongside Claude search readiness. Get the full report and exact fixes.
Claude
ChatGPT
Gemini
PerplexityInstant preview · Full report free by email
Includes all AI platforms and all five readiness categories.
canairead.me
ClaudeBot checker · Full AI readiness report included
Example AI readiness report
canairead.me · 92/100
What we check
ClaudeBot is Anthropic's general-purpose crawler. If it's blocked — deliberately or by a default security rule — your content won't be part of what Claude can access when reasoning about the web.
- Whether ClaudeBot is explicitly allowed or disallowed
- Whether a wildcard rule unintentionally blocks it
- Response codes when ClaudeBot's user-agent requests key pages
Crawlers involved
ClaudeBot
Anthropic
Anthropic's general-purpose crawler for public web content.
Explore the related checker →Common problems
Blocked via managed WAF ruleset
Some CDN-level bot management rulesets block ClaudeBot by default, sometimes without clear disclosure.
How to fix them
Add an explicit directive
Write `User-agent: ClaudeBot` with a clear Allow or Disallow rule in robots.txt.
Check CDN bot management settings
Review Cloudflare, Fastly or similar dashboards for AI-crawler-specific rules that may override robots.txt.
Frequently asked
Why is ClaudeBot blocked even though my robots.txt allows it?
Some CDN or WAF bot-protection layers filter requests before they ever reach your server, overriding what robots.txt says. Check your CDN's bot management settings separately.