SeogaBot
SeogaBot is the checker behind Seoga's free website scan. It visits a page only when someone asks Seoga to check that page, and it reads what any visitor could read.
How it identifies itself
User agent: Mozilla/5.0 (compatible; SeogaBot/1.0; +https://getseoga.com/bot)
robots.txt name: SeogaBot
What it does
- Reads robots.txt first and follows it.
- Makes at most 2 requests a second to one site, and waits longer when a site asks for a crawl delay.
- Reads the page that was asked for, your site map, and the links on that page to see whether they work.
- Checks how a few AI crawlers are treated by sending one request under each of their names. Those requests are clearly part of a check and carry no form data.
- Never logs in, fills in forms or buys anything.
How to stop it
Add these lines to your robots.txt:
User-agent: SeogaBotDisallow: /
Questions: support@getseoga.com