MiraksBot
A fetcher that runs only when a person submits a URL to one of the miraks.biz tools.
What it does
It requests the submitted page, and where a tool needs it, the site's robots.txt, sitemap and a sample of linked URLs. It never crawls a site on its own and does not run on a schedule.
How it identifies itself
The user agent is:
MiraksBot/1.0 (+https://miraks.biz/bot)
Limits
- Only
httpandhttps, on ports 80 and 443. - 10 second timeout, at most 5 redirects, and responses are cut off at 2 MB.
- Private, local and reserved addresses are refused.
- Requests are rate limited per visitor.
Blocking it
Add this to your robots.txt:
User-agent: MiraksBot
Disallow: /