amazon-kendra: what it is and how to block or allow it
User-Agent token: amazon-kendra · Operator: Amazon Web Services · Category: Collects data for AI natural language search
FraudMeNot Verdict
Listed AI Agent
amazon-kendra is the robots.txt token for the Amazon Kendra Web Crawler, which AWS customers use to index websites into their own Kendra search. AWS says it respects Allow and Disallow and that customers must get authorization before indexing a site.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
AWS's Kendra robots.txt page publishes no IP list, so the token alone is a claim.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Generally Low Risk on Public Pages — Verify Before Trusting
For everyday users: amazon-kendra is an indexing crawler set up by AWS customers. A message in its name asking for AWS credentials is likely a scam.
For website owners & security teams: Use a User-agent: amazon-kendra group to allow or disallow it. AWS says customers need authorization before indexing your site.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
amazon-kendra- FraudMeNot_Verdict
- Listed AI Agent
- Operator_Entity
- Amazon Web Services
- Agent_Category
- Collects data for AI natural language search
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW public pages if you approved the crawl; DISALLOW otherwise.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/amazon-kendra/
What We Know About amazon-kendra
Amazon Kendra is an enterprise search service. A company feeds it documents, and its staff search them with natural-language questions. To bring in web pages, the customer sets up the Kendra Web Crawler with seed URLs and crawl settings, and the crawler fetches what it is pointed at.
AWS's robots.txt page for Kendra makes an unusual statement: Kendra customers are required to obtain authorization before indexing any particular website. If you see the crawler and gave no permission, that is worth knowing, though the page does not explain how AWS enforces it.
AWS says the crawler respects standard Allow and Disallow directives under User-agent: amazon-kendra. Its examples cover keeping it out of one folder, letting it into one folder only, letting it in while other robots are kept out, and blocking it from everything.
As of Oct 25, 2026, AWS says Amazon Kendra is no longer open to new customers and points them to Amazon Bedrock Knowledge Bases, whose crawler appears in logs as bedrockbot.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | amazon-kendra |
| Operator | Amazon Web Services · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | AWS says the Amazon Kendra Web Crawler respects robots.txt Allow and Disallow directives. |
Copy-Paste robots.txt & Cloudflare WAF Rules for amazon-kendra
robots.txt — allow public pages, keep private routes off-limits
User-agent: amazon-kendra
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: amazon-kendra
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "amazon-kendra")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Not described by AWS as training; it indexes pages for a customer's Kendra search |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen amazon-kendra? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About amazon-kendra
Who controls an amazon-kendra crawl?
The AWS customer who configured the Kendra Web Crawler with your URLs.
Does it follow robots.txt?
AWS says it respects Allow and Disallow.
Is Kendra still sold?
AWS says it is no longer open to new customers and suggests Bedrock Knowledge Bases. (as of Oct 25, 2026)
Could This Be a Scam? What to Do
- Anyone can copy the amazon-kendra User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the amazon-kendra or Amazon Web Services name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from Amazon Web Services
- amazon-QBusiness — AI Assistants
- bedrockbot — Data scraping for custom AI applications
- Amzn-User — AI Assistants
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), AWS: Configuring the robots.txt file for Amazon Kendra Web Crawler. FraudMeNot is not affiliated with Amazon Web Services. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.