What is Amazonbot?
Used to improve Amazon's products and services; Amazon says its data may also be used to train Amazon AI models.
Collects pages to train language models. Blocking it keeps your pages out of future training data, and does not remove you from AI search answers.
Amazon reads robots.txt per host or uses a cached copy up to 30 days old, and says changes can take about 24 hours.
Amazonbot user agent
Amazon documents this user agent for Amazonbot. Version numbers in it change over time, so match on the name, not the whole string.
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1) Chrome/W.X.Y.Z Safari/537.36Should you block Amazonbot?
Block it if you don’t want your pages used to train models; nothing else changes. Allow it if you’d rather future models know your product, docs or writing.
How to block Amazonbot in robots.txt
Add a group for its token to robots.txt at the root of your site.
A bot follows only the group that names it, so it ignores your User-agent: * rules once it has a group of its own. Repeat any paths you also want kept from it there.
Amazon says its crawlers honor the noarchive (do not use for model training), noindex and none robots meta tags and rel=nofollow, but not Crawl-delay.
User-agent: Amazonbot
Disallow: /How to verify a request is really Amazonbot
Anyone can send any user agent, so the string alone proves nothing.
Amazon publishes the IP ranges Amazonbot crawls from. A request that claims to be Amazonbot from any other address is not Amazonbot.
See when Amazonbot reads your site
Bots don’t run JavaScript analytics, so a script tag never sees them. invisit records crawler reads on the server instead, through its server SDK or a Cloudflare Worker, and shows which bots read which pages, next to your visitors.
Checked against Amazon’s own documentation on . Something changed? Write to help@invisit.dev.