What is SerpstatBot?
It crawls the web to add new links and track changes in Serpstat's backlink database.
Crawls for an SEO product: backlink indexes, site audits, rank data. It sends no visitors; blocking it is common and harmless.
If serpstatbot cannot fetch robots.txt, including a 403, it crawls as if there are no restrictions. It supports Crawl-delay up to 20 seconds.
Should you block SerpstatBot?
Block it freely if the load bothers you. It sends no visitors; the only cost is that the tool’s users, your competitors included, see less of your site.
How to block SerpstatBot in robots.txt
Add a group for its token to robots.txt at the root of your site.
A bot follows only the group that names it, so it ignores your User-agent: * rules once it has a group of its own. Repeat any paths you also want kept from it there.
User-agent: serpstatbot
Disallow: /How to verify a request is really SerpstatBot
Anyone can send any user agent, so the string alone proves nothing.
Serpstat publishes the IP ranges SerpstatBot crawls from. A request that claims to be SerpstatBot from any other address is not SerpstatBot.
See when SerpstatBot reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Serpstat’s own documentation on . Something changed? Write to help@invisit.dev.