What is Amazonbot?

Amazon's crawler for training and improving its products and services. It follows robots.txt and noarchive, but not Crawl-delay.

robots.txt token

Amazonbot

Operator

Amazon

Purpose

Training

Obeys robots.txt

●Yes The operator says it follows robots.txt.

Documented by operator

Yes, on the operator's own pages.

Published IP list

developer.amazon.com/amazonbot/ip-addresses/

Documentation

developer.amazon.com

Block Amazonbot from your whole site

User-agent: Amazonbot
Disallow: /

Allow it, but keep private paths out

User-agent: Amazonbot
Allow: /
Disallow: /admin/

Other bots from Amazon

Add it to a robots.txt in the generator →