What is X-Robots-Tag Checker for?
It inspects response-level crawl/index directives like noindex and nofollow delivered in HTTP headers.
Support
X-Robots-Tag Checker FAQs
Everything you need to know about the X-Robots-Tag Checker tool, how it works, and how to interpret the results.
Can it also inspect meta robots?
Yes. It also reports meta robots content to help identify directive conflicts.
Can I submit URLs without protocol?
Yes. Input is normalized to a valid URL automatically.
Why is this important for SEO?
A noindex header can remove pages from search even when page content and sitemaps look correct.
Does it parse directives?
Yes. The endpoint returns parsed directives and flags for noindex and nofollow.
Is this endpoint stateless?
Yes. It performs a live fetch and returns the result without long-term storage.
How does Tool fit into a technical SEO workflow?
Use Tool as one layer in a repeatable workflow: run diagnostics, log output, compare trend changes, and escalate anomalies before they affect crawl reliability or user experience.
Can I combine Tool with other Velohost tools?
Yes. Teams commonly combine results with DNS, SSL, canonical, and performance checks to build stronger release gates and faster incident triage.