img2dataset
User-Agent token: img2dataset · Operator: img2dataset (open-source tool) · Category: Scrapes images for use in LLMs
FraudMeNot Verdict
AI Data Collection Bot
img2dataset is an open-source tool that downloads large sets of image URLs into datasets, often for AI training. Anyone can run it, so there is no single operator.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
No official IP list is published, so the User-Agent alone cannot prove the request is real.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Unclear.
Judgment Call · What You Should Do
Your Choice — Your Content May Be Collected for AI
For everyday users: img2dataset is a download tool researchers run. Nobody runs an 'img2dataset removal service'; a message offering one is a scam.
For website owners & security teams: Send "X-Robots-Tag: noai, noimageai" on image responses; img2dataset skips those by default, per its README. Users can disable that, so also block the img2dataset User-Agent at the WAF.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Unclear
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
img2dataset- FraudMeNot_Verdict
- AI Data Collection Bot
- Operator_Entity
- img2dataset (open-source tool)
- Agent_Category
- Scrapes images for use in LLMs
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Unclear (not stated by the operator or the ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- SEND X-Robots-Tag noai and noimageai on images; BLOCK the img2dataset token at the WAF for an enforced stop.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/img2dataset/
What We Know About img2dataset
img2dataset is not a company's crawler. It is an open-source Python tool on GitHub that turns large lists of image URLs into image datasets. Its project page says it can download, resize and package 100 million URLs in about 20 hours on one machine. The registry says it downloads large image sets for LLM training or other purposes, and that frequency is at the discretion of its users.
The tool has a documented opt-out, but it uses HTTP headers rather than robots.txt. Its README says websites can send "X-Robots-Tag: noai", "noindex", "noimageai" or "noimageindex", and by default img2dataset will skip images served with those headers.
The README also says users can turn that behavior off by passing an empty list to the disallowed_header_directives option. So the opt-out works only when the person running the tool keeps the default.
If you host images you do not want in AI datasets, send "X-Robots-Tag: noai, noimageai" on image responses, and add a WAF rule on the img2dataset token. The registry lists its robots.txt status as unclear.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | img2dataset |
| Operator | img2dataset (open-source tool) · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | img2dataset honors X-Robots-Tag noai, noindex, noimageai and noimageindex headers by default; users can disable this. The registry lists its robots.txt status as unclear. |
Copy-Paste robots.txt & Cloudflare WAF Rules for img2dataset
robots.txt — allow public pages, keep private routes off-limits
User-agent: img2dataset
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: img2dataset
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "img2dataset")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Often: the registry says it builds image datasets for LLM training or other purposes |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen img2dataset? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About img2dataset
What is img2dataset?
An open-source tool that downloads lists of image URLs into datasets. The registry says these are used for LLM training or other purposes.
How do I opt out of img2dataset?
Its README says it skips images served with X-Robots-Tag noai, noindex, noimageai or noimageindex, by default.
Can img2dataset users ignore my opt-out?
Yes. The README says users can disable header checks, so add a firewall rule on the User-Agent as well.
Could This Be a Scam? What to Do
- Anyone can copy the img2dataset User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the img2dataset or img2dataset (open-source tool) name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More AI Agents
- AddSearchBot — AI Search Crawlers
- adidxbot — Advertising quality crawler
- AgentDataBot — AI Data Providers
- AgentTimes — Data Scraper from RSS Feeds
- AGI Agent — AI Agents
- AhrefsBot — SEO crawler
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), GitHub: rom1504/img2dataset. FraudMeNot is not affiliated with img2dataset (open-source tool). Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.