Google AI crawler checker
Understand Googlebot access and Google-Extended permissions, with the full AI readiness picture in one report.
Instant preview · Full report free by email
Includes all AI platforms and all five readiness categories.
canairead.me
Google AI crawler checker · Full AI readiness report included
Example AI readiness report
canairead.me · 92/100
What we check
Google runs two crawlers relevant to AI visibility: Googlebot, which underpins Search and most AI-grounded features, and Google-Extended, which specifically governs Gemini and Vertex AI model training and grounding access.
- Whether Googlebot can index your pages
- Whether Google-Extended is explicitly allowed or disallowed
- Structured data consistency across key pages
Crawlers involved
Googlebot
Google's primary crawler for search indexing — the foundation most AI Overviews and Gemini grounding relies on.
Explore the related checker →Google-Extended
Controls whether your content can be used to improve Gemini and Vertex AI models, separately from search indexing.
Explore the related checker →Common problems
Google-Extended left undeclared
Without an explicit rule, your default exposure to Gemini training may not match your actual preference.
How to fix them
Add an explicit Google-Extended rule
Decide deliberately, rather than by default, whether your content should inform Gemini/Vertex AI.
Frequently asked
Is Google-Extended the same crawler as Googlebot?
No — they're declared separately in robots.txt and control different things: Googlebot for Search indexing, Google-Extended for Gemini/Vertex AI training and grounding.