Check which systems can retrieve your pages.
Robots rules, server responses, rendered content and hosting restrictions. Search access and training controls follow your policy.
What this includes
- Check whether relevant AI search crawlers can access public pages.
- Investigate blocked requests, server errors and content missing from the retrieved page.
- Review hosting and security restrictions that may affect access.
- Separate search retrieval permissions from model-training permissions.
- Apply the access policy agreed with you and verify it after publication.
- Use server records to investigate visits where available; a bot visit is not a citation.