Page reachable
What the check finds
The URL returns 404 or 410. No content, metadata or metrics could be collected.
The origin refused our crawler (401, 403, 429 or similar). Whatever blocks us blocks the AI crawlers arriving the same way.
Why it matters for AI answers
A page that returns an error has nothing to index or cite. If the site blocks automated visitors, AI crawlers that arrive the same way are often blocked as well.
How to fix it
- If the page moved, add a 301 to the new URL. If it is gone for good, remove links to it.
- Check firewall, bot protection and rate limits for rules that return 401, 403 or 429 to crawlers.
- Allow the crawlers the brand wants by user agent, for example OAI-SearchBot, Claude-SearchBot, PerplexityBot.
Related checks
Review this finding in context: Indexability and crawlability guide ›
Still stuck? Contact support ›