Skip to main content

Website Crawlability Check

See what your homepage makes available to search systems and review the crawler rules your site publishes. The check reads your homepage and selected public files, then highlights useful follow-up questions.

A public-file check of the homepage, not a measure of search rankings or AI citations. It does not test browser behavior or every page.

What this check does

We request the homepage, robots.txt, and llms.txt and report the public-file findings. Results may be cached for up to 30 minutes. They are not emailed or used for outreach.

Reviewed October 2026