AI2Bot
User-Agent token: AI2Bot · Operator: Ai2 · Category: Content is used to train open language models
FraudMeNot Verdict
AI Data Collection Bot
Ai2 (the Allen Institute for AI) runs AI2Bot. The ai.robots.txt registry says content it collects is used to train open language models.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
No official IP list is published, so the User-Agent alone cannot prove the request is real.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Your Choice — Your Content May Be Collected for AI
For everyday users: AI2Bot is a research crawler. It reads public pages and has no reason to contact you, ask for money, or log into anything. A message that says it is from "AI2Bot" or "Ai2 security" and asks you to click a link or pay is not from the crawler.
For website owners & security teams: Ai2 says its crawler identifies itself as AI2Bot and that you may filter on that string. If you do not want your content in open-model training data, add a robots.txt disallow for AI2Bot; the registry lists it as respecting robots.txt. With no published IP list, a WAF rule on the name is the only enforced block.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
AI2Bot- FraudMeNot_Verdict
- AI Data Collection Bot
- Operator_Entity
- Ai2
- Agent_Category
- Content is used to train open language models
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW or DISALLOW per your open-model training policy; filter on the AI2Bot string, as Ai2 suggests.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/ai2bot/
What We Know About AI2Bot
AI2Bot is the web crawler of Ai2, the nonprofit research group formerly known as the Allen Institute for AI. The ai.robots.txt registry describes its purpose in one line: content is used to train open language models. The registry quotes Ai2 as saying the crawler explores "certain domains" to find web content, rather than the whole web.
Ai2 publishes a short crawler page. It says the crawler always sends a User-Agent header that contains AI2Bot and a link back to allenai.org/crawler, and that site owners can use this string to filter or reject its traffic. The page also invites questions or concerns by contact form. Ai2 does not publish an IP address list on that page, so a log line with the AI2Bot name cannot be checked against official ranges.
The registry lists AI2Bot as respecting robots.txt. For a publisher, the decision is mostly about whether you want your public writing in openly released training sets. Because models built from open data can be copied and reused by anyone, opting out later does not pull back copies already made. So decide before the crawler visits, not after.
Checking a visit: look for the exact string "AI2Bot (+https://www.allenai.org/crawler)" in the User-Agent. A request that uses the AI2Bot name but behaves like a login bot, posts forms, or hammers search pages does not match how Ai2 describes its crawler. Block it, whatever name it uses.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | AI2Bot |
| Operator | Ai2 · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | The ai.robots.txt registry lists AI2Bot as respecting robots.txt. Ai2 says the User-Agent string can be used to filter or reject its requests. |
Copy-Paste robots.txt & Cloudflare WAF Rules for AI2Bot
robots.txt — allow public pages, keep private routes off-limits
User-agent: AI2Bot
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: AI2Bot
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "AI2Bot")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Yes, per the ai.robots.txt registry: content is used to train open language models |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen AI2Bot? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About AI2Bot
Who operates AI2Bot?
Ai2, the nonprofit AI research institute formerly called the Allen Institute for AI. Its crawler page is at allenai.org/crawler.
What does AI2Bot do with my pages?
The ai.robots.txt registry says the content is used to train open language models. Ai2 describes the crawler as exploring certain domains for web content.
How do I stop AI2Bot?
Add "User-agent: AI2Bot" and "Disallow: /" to robots.txt. Ai2 also says its User-Agent string can be used to filter or reject traffic at your server or firewall.
Could This Be a Scam? What to Do
- Anyone can copy the AI2Bot User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the AI2Bot or Ai2 name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More AI Agents
- Ai2Bot-Dolma — Content is used to train open language models
- AddSearchBot — AI Search Crawlers
- adidxbot — Advertising quality crawler
- AgentDataBot — AI Data Providers
- AgentTimes — Data Scraper from RSS Feeds
- AGI Agent — AI Agents
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Ai2: Crawler page. FraudMeNot is not affiliated with Ai2. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.