ClaudeBot checker
Understand ClaudeBot access alongside Claude search readiness. Get the full report and exact fixes.
Claude
ChatGPT
Gemini
PerplexityInstant preview · Full report free by email
Includes all AI platforms and all five readiness categories.
canairead.me
ClaudeBot checker · Full AI readiness report included
Example AI readiness report
canairead.me · 92/100
What we check
ClaudeBot is Anthropic's general-purpose crawler. If it's blocked — deliberately or by a default security rule — your content won't be part of what Claude can access when reasoning about the web.
- Whether ClaudeBot is explicitly allowed or disallowed
- Whether a wildcard rule unintentionally blocks it
- Response codes when ClaudeBot's user-agent requests key pages
Passing technical checks is only the starting point. Read why your site might not show up in ChatGPT to work through access, rendering and content issues before expecting citations.
See exactly what is tested and what a score cannot prove in the scan methodology and limitations.
Crawlers involved
ClaudeBot
Anthropic
Anthropic's general-purpose crawler for public web content.
Anthropic crawler documentation ↗Explore the related checker →Common problems
Blocked via managed WAF ruleset
Some CDN-level bot management rulesets block ClaudeBot by default, sometimes without clear disclosure.
How to fix them
Add an explicit directive
Write `User-agent: ClaudeBot` with a clear Allow or Disallow rule in robots.txt.
Check CDN bot management settings
Review Cloudflare, Fastly or similar dashboards for AI-crawler-specific rules that may override robots.txt.
Frequently asked
Why is ClaudeBot blocked even though my robots.txt allows it?
Some CDN or WAF bot-protection layers filter requests before they ever reach your server, overriding what robots.txt says. Check your CDN's bot management settings separately.
Primary documentation
Crawler descriptions were reviewed 2026-09-12. Product behavior can change; verify decisions against the current source.