AI Crawler Check
Check if AI crawlers (GPTBot, ClaudeBot, PerplexityBot…) can see your site — a quick GEO readiness report.
Fetches your robots.txt and checks it against 16 known AI crawlers from OpenAI, Anthropic, Google, Perplexity, Meta and others.
Checking robots.txt...
0%
GEO Readiness Score
GEO = Generative Engine Optimization: how visible your content is to AI answer engines.
Crawler Report
Allowed
Partial
Blocked
| Provider | User-agent | Status | Matching rule |
|---|
robots.txt preview
Tip: pair this with the llms.txt Generator — robots.txt decides who may crawl, llms.txt tells AI agents what your site is about. llms.txt Generator →
