bedrockbot: what it is and how to block or allow it
User-Agent token: bedrockbot · Operator: Amazon · Category: Data scraping for custom AI applications
FraudMeNot Verdict
AI Data Collection Bot
bedrockbot is the Amazon Bedrock Web Crawler, which AWS customers point at websites to fill their own knowledge bases. AWS says it respects robots.txt per RFC 9309.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
AWS publishes no IP list for bedrockbot on its docs page, so the User-Agent alone cannot confirm the request.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Your Choice — Your Content May Be Collected for AI
For everyday users: bedrockbot runs inside AWS customer accounts to read web pages. Calls or emails claiming to be "Amazon Bedrock security" and asking for card details or codes are probably fraud.
For website owners & security teams: A genuine bedrockbot visit means an AWS customer configured a crawl of your URLs (the name can be spoofed). Disallow bedrockbot for all, or allow a specific bedrockbot-UUID you trust. AWS says a missing robots.txt means disallow by default.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
bedrockbot- FraudMeNot_Verdict
- AI Data Collection Bot
- Operator_Entity
- Amazon
- Agent_Category
- Data scraping for custom AI applications
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- DISALLOW bedrockbot generally, or ALLOW a specific bedrockbot-UUID you have agreed to.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/bedrockbot/
What We Know About bedrockbot
bedrockbot is not one company crawling the web for itself. AWS documents it as the Web Crawler data source for Amazon Bedrock knowledge bases: an AWS customer gives it source URLs, and it fetches those pages into that customer's knowledge base for retrieval-augmented answers.
AWS says the crawler respects robots.txt in accordance with RFC 9309, and disallows by default if no robots.txt is found. It looks first for rules aimed at bedrockbot-UUID, a per-crawler identifier, and then for general bedrockbot rules. That lets a site allow one customer's crawler while blocking others.
AWS also lets customers add a custom User-Agent suffix, which it says can be used to allowlist their crawler in bot protection systems. AWS tells customers they must only crawl their own pages or pages they are authorized to crawl, under the Amazon Acceptable Use Policy.
AWS does not publish a bedrockbot IP list on that page. If you see heavy bedrockbot traffic you did not expect, in our view the practical step is a robots.txt group for bedrockbot, and if needed a rate limit, rather than assuming who the customer is.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | bedrockbot |
| Operator | Amazon · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | AWS says the Bedrock Web Crawler respects robots.txt per RFC 9309, checks bedrockbot-UUID rules before generic bedrockbot rules, and disallows by default when robots.txt is missing. |
Copy-Paste robots.txt & Cloudflare WAF Rules for bedrockbot
robots.txt — allow public pages, keep private routes off-limits
User-agent: bedrockbot
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: bedrockbot
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "bedrockbot")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Not stated; AWS describes it as filling customers' knowledge bases |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen bedrockbot? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About bedrockbot
Who runs bedrockbot?
AWS provides it as the Web Crawler for Amazon Bedrock knowledge bases; individual AWS customers choose what it crawls.
Can I allow just one customer?
Yes. AWS says the crawler checks bedrockbot-UUID rules before generic bedrockbot rules.
What if I have no robots.txt?
AWS says the crawler disallows by default when robots.txt is not found.
Could This Be a Scam? What to Do
- Anyone can copy the bedrockbot User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the bedrockbot or Amazon name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from Amazon
- Amazonbot — Service improvement and enabling answers for Alexa users
- amazon-kendra — Collects data for AI natural language search
- amazon-QBusiness — AI Assistants
- AmazonBuyForMe — AI Agents
- NovaAct — AI Agents
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), AWS Docs: Crawl web pages for your knowledge base. FraudMeNot is not affiliated with Amazon. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.