ExaSearchBot: what it is and how to block or allow it
User-Agent token: ExaSearchBot · Operator: Exa · Category: AI Search Crawlers
FraudMeNot Verdict
Listed AI Agent
ExaSearchBot is the crawler that builds Exa's search index. Exa says it respects robots.txt, signs every request with Web Bot Auth, and does not try to get past logins, paywalls or CAPTCHAs.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
Validate the request signature against Exa's key directory rather than trusting the string.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Unclear.
Judgment Call · What You Should Do
Generally Low Risk on Public Pages — Verify Before Trusting
For everyday users: ExaSearchBot is an indexing crawler. Treat anyone using its name to ask for money or a password as running a likely scam.
For website owners & security teams: Give ExaSearchBot its own robots.txt group, or it may inherit your search-engine rules. Use noindex to remove pages already indexed.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Unclear
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
ExaSearchBot- FraudMeNot_Verdict
- Listed AI Agent
- Operator_Entity
- Exa
- Agent_Category
- AI Search Crawlers
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Exa signs ExaSearchBot requests with HTTP Message Signatures (RFC 9421)
- Respects_Robots_Txt
- Unclear (not stated by the operator or the ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW if you want Exa search visibility; verify by signature.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/exasearchbot/
What We Know About ExaSearchBot
Exa sells search to developers and AI products. ExaSearchBot discovers and refreshes public pages so that they can be found, retrieved and cited through Exa. Live, one-off fetches requested by users go out under a different name, ExaUser.
Exa explains how ExaSearchBot picks rules. It first looks for a group naming ExaSearchBot. If there is none, it follows the rules you set for major search engines, and failing that the * group. So a site that blocks Googlebot but says nothing to Exa may also be blocking Exa.
Exa notes that robots.txt controls crawling, not indexing. To drop a page already in its index, it says to serve a noindex robots meta tag or an X-Robots-Tag: noindex header; the page is removed after the next re-fetch.
Verification does not depend on IP. Every request carries Signature, Signature-Input and Signature-Agent headers per RFC 9421, and Exa publishes Ed25519 keys in a key directory. Exa says Cloudflare, Akamai and similar providers validate it automatically, and that it rate-limits per site and submits no forms.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | ExaSearchBot |
| Operator | Exa · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Exa signs ExaSearchBot requests with HTTP Message Signatures (RFC 9421); keys at crawler.exa.ai/.well-known/http-message-signatures-directory. |
| robots.txt behavior | Exa says ExaSearchBot respects the Robots Exclusion Protocol, falling back to your major-search-engine rules, then *, when no ExaSearchBot group exists. |
Copy-Paste robots.txt & Cloudflare WAF Rules for ExaSearchBot
robots.txt — allow public pages, keep private routes off-limits
User-agent: ExaSearchBot
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: ExaSearchBot
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "ExaSearchBot")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Not stated by Exa; it describes the purpose as search and retrieval |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Exa says it submits no forms and does not bypass logins, paywalls or CAPTCHAs. |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen ExaSearchBot? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About ExaSearchBot
Which rules does ExaSearchBot follow if I don't name it?
Exa says it follows your rules for major search engines, otherwise the * group.
How do I remove a page from Exa?
Exa says to use a noindex meta tag or X-Robots-Tag header.
How do I verify ExaSearchBot?
Check its Web Bot Auth signature against Exa's published keys.
Could This Be a Scam? What to Do
- Anyone can copy the ExaSearchBot User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the ExaSearchBot or Exa name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from Exa
- ExaUser — AI Assistants
- OAI-SearchBot — AI Search Crawler (ChatGPT search)
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Exa: Exa Search Crawler, Exa: FAQs. FraudMeNot is not affiliated with Exa. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.