Claude-SearchBot
User-Agent token: Claude-SearchBot · Operator: Anthropic · Category: Claude-SearchBot navigates the web to improve search result
FraudMeNot Verdict
Listed AI Agent
Anthropic says Claude-SearchBot navigates the web to improve search result quality for users, analyzing content to make Claude's search answers more relevant and accurate.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
No official IP list is published, so the User-Agent alone cannot prove the request is real.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Generally Low Risk on Public Pages — Verify Before Trusting
For everyday users: Claude-SearchBot indexes public pages so Claude can find them. It will not contact you. Messages claiming to be "Claude-SearchBot" or "Anthropic security" that ask for your Claude login or a payment are phishing.
For website owners & security teams: Treat Claude-SearchBot as a search decision. Anthropic says blocking it can reduce your visibility in Claude's search results. Anthropic says robots.txt is the reliable opt-out and IP blocking may not hold, so use the token rather than an IP list.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
Claude-SearchBot- FraudMeNot_Verdict
- Listed AI Agent
- Operator_Entity
- Anthropic
- Agent_Category
- Claude-SearchBot navigates the web to improve search result
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW for visibility in Claude search answers; DISALLOW to opt out of Claude search indexing; set ClaudeBot separately.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/claude-searchbot/
What We Know About Claude-SearchBot
Claude-SearchBot is one of three bots Anthropic describes in its help article on web crawling. The others are ClaudeBot, which collects content that may be used for training, and Claude-User, which fetches pages when a person asks Claude a question. Claude-SearchBot sits between them: Anthropic says it navigates the web to improve search result quality and analyzes content to make search responses more relevant and accurate.
Anthropic says that disabling Claude-SearchBot prevents its system from indexing your content for search optimization, which Anthropic says may reduce your visibility in user search results. Blocking it is therefore a search-visibility choice, separate from opting out of training through ClaudeBot.
Anthropic also warns that blocking its IP addresses may not work correctly or persistently guarantee an opt-out, and says robots.txt is the way to opt out. The ai.robots.txt registry lists Claude-SearchBot as respecting robots.txt.
Our take: if you want to appear when Claude searches the web but do not want your pages used for training, allow Claude-SearchBot and Claude-User and disallow ClaudeBot. That split is what Anthropic's separate tokens are for.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | Claude-SearchBot |
| Operator | Anthropic · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | Anthropic says its bots honor robots.txt and that IP blocking may not reliably opt you out. The registry lists Claude-SearchBot as respecting robots.txt. |
Copy-Paste robots.txt & Cloudflare WAF Rules for Claude-SearchBot
robots.txt — allow public pages, keep private routes off-limits
User-agent: Claude-SearchBot
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: Claude-SearchBot
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "Claude-SearchBot")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Separate control: Anthropic describes ClaudeBot as the training-related bot; Claude-SearchBot is for search quality |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen Claude-SearchBot? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About Claude-SearchBot
What is Claude-SearchBot?
Anthropic's search crawler. Anthropic says it navigates the web to improve search result quality for Claude users.
What happens if I block Claude-SearchBot?
Anthropic says it prevents its system from indexing your content for search optimization, which may reduce your visibility in user search results.
Is Claude-SearchBot the same as ClaudeBot?
No. Anthropic lists them separately: ClaudeBot collects content that may contribute to training, while Claude-SearchBot is for search quality.
Could This Be a Scam? What to Do
- Anyone can copy the Claude-SearchBot User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the Claude-SearchBot or Anthropic name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from Anthropic
- anthropic-ai — Scrapes data to train Anthropic's AI products
- Claude-User — AI Assistants
- Claude-Web — Undocumented AI Agents
- ClaudeBot — Scrapes data to train Anthropic's AI products
- AddSearchBot — AI Search Crawlers
- adidxbot — Advertising quality crawler
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Anthropic Help Center: crawling and blocking. FraudMeNot is not affiliated with Anthropic. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.