Every check / content-signal-malformed
Is the Content-Signal line in your robots.txt written so crawlers can read it?
We read every Content-Signal line in your robots.txt and check each entry is one of search, ai-input or ai-train, set to yes or no.
How it decides
The check speaks up when an entry is something else, as a note with no price on it, and stays quiet when there is no line.
Run this check on any website
Free, with no account. It sends the site nothing an ordinary visitor would not.
Why it matters
A signal only works when it parses.
In more detail
A misspelt key or a value other than yes or no is ignored by every crawler that reads the line, so the site says less than its owner thinks it does.
Who fixes it, and where it runs
- Who usually fixes it
- Whoever built your site
- Which plan runs it
- The free scan, on any website
- Proof you own the site
- Not needed. It sends your site nothing an ordinary visitor would not.
More about this check
- Who it is about
- A search engine
- Listed under
- Being found
- The standard
- Its name in a report
content-signal-malformed