Every check / invisible-to-ai-assistants
Is your robots.txt turning away the AI assistants people ask for recommendations?
We read your robots.txt for rules that turn away the crawlers AI assistants send when they answer somebody's question.
How it decides
Those are OAI-SearchBot and ChatGPT-User, Claude-SearchBot and Claude-User, PerplexityBot and Perplexity-User, and Google-Extended. The check speaks up when any of them is blocked. Crawlers that only gather training data, such as GPTBot, are left out, because blocking them costs no visibility today.
Run this check on any website
Free, with no account. It sends the site nothing an ordinary visitor would not.
Why it matters
When somebody asks an assistant to recommend a business like yours, a site it may not read cannot be part of the answer.
In more detail
Some owners block on purpose. Most inherited the rule from a template or a hosting setting and do not know it is there.
Who fixes it, and where it runs
- Who usually fixes it
- Whoever built your site
- Which plan runs it
- The free scan, on any website
- Proof you own the site
- Not needed. It sends your site nothing an ordinary visitor would not.
More about this check
- Who it is about
- A search engine
- Listed under
- Being found
- The standard
- Its name in a report
invisible-to-ai-assistants