Skip to content

Amazonbot: Check If Amazon's Crawler Can Reach You

Amazonbot is Amazon's web crawler; Amazon says it improves its products and services and may be used to train Amazon AI models. A separate bot, Amzn-SearchBot, makes pages eligible for Alexa and Amazon search answers. Enter your site to see what robots.txt and your server allow each one.

Try:

We check what your robots.txt allows each Amazon agent and what your server returns to a request with its user agent. Firewalls that verify bots by IP address may treat our test differently from the real crawler.

We read your live robots.txt and request the page as Amazonbot, Amzn-SearchBot and Amzn-User, with Googlebot as a control. Free, no signup. Updated Oct 24, 2026 by the AEOeye team.

What is Amazonbot used for?

Amazon now documents three agents, each controlled separately in robots.txt (Amazon):

Agent What Amazon says it does AI training?
Amazonbot Improves Amazon products and services May be used to train Amazon AI models
Amzn-SearchBot Makes content eligible for search experiences such as Alexa No
Amzn-User Fetches live pages when a user asks Alexa something No; may not follow every robots.txt rule

Amazon adds two practical details: changes can take about 24 hours to apply, and its crawlers don't support the crawl-delay directive.

Two workers handle a package in a spacious warehouse surrounded by shelves stocked with boxes and products.
Photo by Tiger Lily on Pexels

Should I block Amazonbot?

Decide on the two main bots separately. Blocking Amazonbot opts you out of a crawler that may feed Amazon's AI training; blocking Amzn-SearchBot removes you from answers in Alexa and Amazon's search experiences.

For most brands, allowing Amzn-SearchBot is the easy call — it's a visibility bot with no training use. Amazonbot is the same kind of training decision as GPTBot or ClaudeBot.

What do real sites do?

When we checked the robots.txt files of 391 well-known sites in October 2026 (dataset), 9.4% blocked Amazonbot — 60.5% of news publishers, but only 1.6% of SaaS companies.

The newer bot is barely on anyone's radar: only 2.6% of robots.txt files named Amzn-SearchBot at all, and 3.4% blocked it, mostly through broad rules aimed at every bot.

Close-up of an orange smart speaker with a glowing blue light, showcasing modern technology.
Photo by Robert So on Pexels

Does Amzn-SearchBot follow my other rules?

Partly. Amazon says that if robots.txt doesn't mention Amzn-SearchBot but allows other search bots, Amzn-SearchBot follows the directives given to those search bots. Naming it explicitly removes the guesswork.

Standard matching still applies: the most specific user-agent group wins (RFC 9309), and Amazon reads robots.txt per host — shop.example.com needs its own file.

What rules should I copy?

To stay in Alexa answers but opt out of training:

User-agent: Amazonbot
Disallow: /

User-agent: Amzn-SearchBot
Allow: /

Amazon also honors page-level robots meta tags: noarchive (don't use the page for model training), noindex and none. Check every AI bot at once with the AI crawler checker, or build a full policy with the AI robots.txt generator.

Reachable is step one. Does AI actually recommend you?

Run a free AI visibility audit: we ask ChatGPT the questions your buyers ask and show whether your brand comes up.

FAQ

Is Amazonbot used for AI training?

+

Amazon says Amazonbot may be used to train Amazon AI models. Its other two agents, Amzn-SearchBot and Amzn-User, are documented as not crawling content for generative AI training.

Does blocking Amazonbot remove me from Alexa?

+

Not by itself. Alexa and Amazon search answers depend on Amzn-SearchBot, which has its own robots.txt group. Block Amazonbot and allow Amzn-SearchBot to keep that visibility.

Does Amazonbot support crawl-delay?

+

No. Amazon says its crawlers do not support the crawl-delay directive. To reduce load, use robots.txt rules, rate limiting on your server, or contact Amazon at the address it publishes.

Sources

Related free tools

All ai search & crawlers tools