Amazonbot
Amazon crawler, type: ai training.
- 3,516,853sites name it in robots.txt
- 2,456,303block it fully (69.8%)
- 947,485block some paths
- 113,065allow it explicitly
About this crawler
Amazon's crawler used to improve Amazon products and services; content may be used to train Amazon AI models.
- User-Agent
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Amazonbot/0.1)- robots.txt token
amazonbot- Respects robots.txt
- yes
- Published IP ranges
- https://developer.amazon.com/amazonbot/ip-addresses/
- Operator page
- https://developer.amazon.com/amazonbot
- Page says it respects the Robots Exclusion Protocol and host-level directives
- robots.txt changes take approximately 24 hours to be reflected in Amazon's systems
- Amazon documents separate bots Amzn-SearchBot (search, no gen-AI training) and Amzn-User (user-initiated, may not follow all robots.txt directives)
Including sites that block it only through the * group, 7.66% of all sites with a robots.txt keep it out.