TDM reservation present and valid
What the check finds
No /.well-known/tdmrep.json. TDMRep is the W3C way to state a mining policy; crawlers that honour it use their default without one.
The text and data mining reservation at /.well-known/tdmrep.json is malformed. Crawlers that honour it cannot read the site's stated policy, so they fall back to their own default.
Why it matters for AI answers
TDMRep lets a site reserve its text and data mining rights in a machine-readable way, with legal weight in the EU. Few AI crawlers are known to read it, so robots.txt matters more.
How to fix it
- Publish /.well-known/tdmrep.json as a JSON array of rules with location and tdm-reservation (1 or 0).
- Add tdm-policy with a policy URL if mining is allowed under licence.
- Validate the JSON and serve it with Content-Type: application/json and status 200.
- Keep the policy consistent with robots.txt rules for training crawlers.
Related checks
Review this finding in context: AI access and guidance guide ›
Still stuck? Contact support ›