AI Visibility Checker
AI Visibility CheckerSee your website the way AI search engines see it.
The 10 crawlers we evaluate
Each one gets its own robots.txt verdict, because they are separate user-agents with separate rules. OpenAI alone ships three: you can allow ChatGPT search while opting out of training.
OpenAI
3 crawlers
Anthropic
2 crawlers
Perplexity
1 crawler
1 crawler
Common Crawl
1 crawler
ByteDance
1 crawler
Meta
1 crawler
What each crawler is for, and how the 100-point score works
OpenAI
3 crawlers
GPTBot
Model training
OAI-SearchBot
ChatGPT search index
ChatGPT-User
Live ChatGPT browsing
Anthropic
2 crawlers
ClaudeBot
Model training
anthropic-ai
Legacy Anthropic crawler
Perplexity
1 crawler
PerplexityBot
Perplexity search index
1 crawler
Google-Extended
Gemini training & grounding
Common Crawl
1 crawler
CCBot
Open dataset many models train on
ByteDance
1 crawler
Bytespider
Model training
Meta
1 crawler
meta-externalagent
Llama training
What the score is made of
- AI crawler access40 pts
- The effective robots.txt rule for the path “/” for each of the 10 crawlers above.
- Structured data (JSON-LD)20 pts
- Every ld+json block on your homepage, and the @type values it declares — what you tell engines you are, instead of making them guess.
- On-page basics20 pts
- Nine signals answer engines quote: title, meta description, an h1, at least two h2s, a lang attribute, Open Graph tags, a canonical link, image alt-text coverage, and a minimum word count so a near-empty page cannot pass by accident.
- llms.txt10 pts
- Whether /llms.txt exists — a curated markdown map for AI systems.
- XML sitemap10 pts
- A Sitemap: line in robots.txt, or a /sitemap.xml that responds.
- HTTPS, mobile viewport, rich schema, author & social signalsnot scored
- Seven further signals reported for context — HTTPS, a mobile viewport tag, FAQ/Article/HowTo-style schema, author/byline/publish-date signals, Twitter Card completeness, and noai/noindex directives. Not part of the 100-point score, but each has its own fix.
100/100 means AI engines can read and parse you — not that they will cite you.
