What is Barkrowler?
Babbar's crawler, which builds a graph of the web for Babbar's SEO and online marketing tools.
Crawls for an SEO product: backlink indexes, site audits, rank data. It sends no visitors; blocking it is common and harmless.
Babbar says it stores links and page metadata, not page content, and waits 5 seconds between requests to the same host.
Should you block Barkrowler?
Block it freely if the load bothers you. It sends no visitors; the only cost is that the tool’s users, your competitors included, see less of your site.
How to block Barkrowler in robots.txt
Add a group for its token to robots.txt at the root of your site.
A bot follows only the group that names it, so it ignores your User-agent: * rules once it has a group of its own. Repeat any paths you also want kept from it there.
User-agent: barkrowler
Disallow: /How to verify a request is really Barkrowler
Anyone can send any user agent, so the string alone proves nothing.
Or check by reverse DNS: look up the hostname of the request’s IP, confirm it ends in babbar.eu, then look that hostname up again and confirm it points back to the same IP.
See when Barkrowler reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Babbar’s own documentation on . Something changed? Write to help@invisit.dev.