Google AI crawler checker
Understand Googlebot access and Google-Extended permissions, with the full AI readiness picture in one report.
Gemini
ChatGPT
Claude
PerplexityInstant preview · Full report free by email
Includes all AI platforms and all five readiness categories.
canairead.me
Google AI crawler checker · Full AI readiness report included
Example AI readiness report
canairead.me · 92/100
What we check
Googlebot crawls for Search, which underpins Google Search AI features. Google-Extended is a separate robots.txt product token—not a separate HTTP crawler—and controls certain Gemini and Vertex AI training and grounding uses without affecting Search inclusion.
- Whether Googlebot can index your pages
- Whether Google-Extended is explicitly allowed or disallowed
- Structured data consistency across key pages
Passing technical checks is only the starting point. Read why your site might not show up in ChatGPT to work through access, rendering and content issues before expecting citations.
See exactly what is tested and what a score cannot prove in the scan methodology and limitations.
Crawlers involved
Googlebot
Google's primary crawler for search indexing — the foundation most AI Overviews and Gemini grounding relies on.
Google Search Central documentation ↗Explore the related checker →Google-Extended
Controls whether your content can be used to improve Gemini and Vertex AI models, separately from search indexing.
Google Search Central documentation ↗Explore the related checker →Common problems
Google-Extended left undeclared
Without an explicit rule, your default exposure to Gemini training may not match your actual preference.
How to fix them
Add an explicit Google-Extended rule
Decide deliberately, rather than by default, whether your content should inform Gemini/Vertex AI.
Frequently asked
Is Google-Extended the same crawler as Googlebot?
No — they're declared separately in robots.txt and control different things: Googlebot for Search indexing, Google-Extended for Gemini/Vertex AI training and grounding.
Primary documentation
Crawler descriptions were reviewed 2026-09-12. Product behavior can change; verify decisions against the current source.