AI Crawler Access Checker
Shows which AI crawlers robots.txt allows, and whether content is in the raw HTML.
What this tool checks
- Allow or block per known AI crawler
- llms.txt
- noai and noimageai directives
- Visible text in the initial HTML
Results come from code that fetches the page as MiraksBot and parses it. Pages you check and their results are not stored. An optional AI explanation is generated from the issue list only and is labelled as such.