What is Storebot-Google?
It crawls pages for every surface of Google Shopping, such as the Shopping tab in Google Search.
Crawls pages for a classic search index. Blocking it removes you from that search engine.
Storebot-Google user agent
Google documents these user agents for Storebot-Google. Version numbers in it change over time, so match on the name, not the whole string.
Mozilla/5.0 (X11; Linux x86_64; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Safari/537.36
Mozilla/5.0 (Linux; Android 8.0; Pixel 2 Build/OPD3.170816.012; Storebot-Google/1.0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/W.X.Y.Z Mobile Safari/537.36Should you block Storebot-Google?
Allow it unless you want out of that search engine. Blocking a major search crawler removes your pages from its results.
How to block Storebot-Google in robots.txt
Add a group for its token to robots.txt at the root of your site.
A bot follows only the group that names it, so it ignores your User-agent: * rules once it has a group of its own. Repeat any paths you also want kept from it there.
User-agent: Storebot-Google
Disallow: /How to verify a request is really Storebot-Google
Anyone can send any user agent, so the string alone proves nothing.
Google publishes the IP ranges Storebot-Google crawls from. A request that claims to be Storebot-Google from any other address is not Storebot-Google.
Or check by reverse DNS: look up the hostname of the request’s IP, confirm it ends in googlebot.com, then look that hostname up again and confirm it points back to the same IP.
See when Storebot-Google reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Google’s own documentation on . Something changed? Write to help@invisit.dev.