Can Claude read your website?
Find what stops Claude reading your site — and get the exact fixes, plus your full AI readiness report.
Claude
ChatGPT
Gemini
PerplexityInstant preview · Full report free by email
Includes all AI platforms and all five readiness categories.
canairead.me
Can Claude read your website? · Full AI readiness report included
Example AI readiness report
canairead.me · 92/100
What we check
Anthropic operates ClaudeBot for general content access and Claude-SearchBot specifically for live citations when Claude searches the web. As with other platforms, allowing one doesn't automatically allow the other.
- robots.txt rules for ClaudeBot and Claude-SearchBot
- Whether content is accessible without JavaScript execution
- Structured data and entity clarity signals
- Content structure Claude can reliably summarise
Crawlers involved
ClaudeBot
Anthropic
Anthropic's general-purpose crawler for public web content.
Explore the related checker →Claude-SearchBot
Anthropic
Powers live citations when Claude uses web search.
Explore the related checker →Claude-User
Anthropic
Fetches a page when a user directly asks Claude to read a specific URL.
Explore the related checker →Common problems
ClaudeBot disallowed by default security settings
Some hosting platforms ship with AI crawlers blocked out of the box.
Ambiguous business description
Claude tends to be conservative about claims it isn't confident in — vague copy often gets summarised vaguely.
How to fix them
Explicitly allow ClaudeBot and Claude-SearchBot
Add clear directives rather than relying on host defaults.
Write one unambiguous description
State what you do, for whom, in the first two sentences of your homepage.
Frequently asked
Does Claude train on my content if I allow ClaudeBot?
ClaudeBot's crawl may be used to inform Anthropic's models, similar to how other AI companies use general crawl data. Check Anthropic's current documentation for specifics on data usage.
Is Claude-SearchBot the same as ClaudeBot?
No — Claude-SearchBot specifically powers live citations during Claude's web search feature, while ClaudeBot is a more general-purpose crawler.