AI Agent & Bot CheckOperator: NICT (National Institute of Information and Communications Technology, Japan)

ICC-Crawler

User-Agent token: ICC-Crawler · Operator: NICT (National Institute of Information and Communications Technology, Japan) · Category: Scrapes data to train and support AI technologies

FraudMeNot Verdict

AI Data Collection Bot

ICC-Crawler is run by a research institute at Japan's NICT. The registry says the data is used for AI technologies and may be provided to third parties, including companies.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

No official IP list is published, so the User-Agent alone cannot prove the request is real.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Yes.

Judgment Call · What You Should Do

Your Choice — Your Content May Be Collected for AI

For everyday users: ICC-Crawler is a government research crawler. A research crawler has no reason to email you, so ignore any message that borrows its name.

For website owners & security teams: NICT says ICC-Crawler data is used for AI and can be shared with third parties, including companies. Disallow it in robots.txt if you object; the registry lists it as respecting robots.txt, and NICT offers to stop on request.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

1

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Yes

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
ICC-Crawler
FraudMeNot_Verdict
AI Data Collection Bot
Operator_Entity
NICT (National Institute of Information and Communications Technology, Japan)
Agent_Category
Scrapes data to train and support AI technologies
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Yes (per ai.robots.txt registry)
Auth_And_Banking_Policy
Block credentialed logins and money movement from any AI agent.
Recommended_Gatekeeper_Action
ALLOW or DISALLOW per your data-sharing policy; data may reach third-party companies, per the registry.
Canonical_Citation_URL
https://fraudmenot.com/bot/icc-crawler/

What We Know About ICC-Crawler

ICC-Crawler is operated by the Universal Communication Research Institute at Japan's National Institute of Information and Communications Technology (NICT), a government research body. NICT's page describes it as a program that automatically crawls the Internet and collects web pages.

The ai.robots.txt registry summarizes NICT's stated purpose: the collected data is used for artificial intelligence technologies and may be provided to third parties, including commercial companies, who can use it for their own business. NICT says information collected on and after July 11, 2024 is used under that stated purpose.

NICT says it takes care not to place an excessive load on target hosts, and that if ICC-Crawler does cause a problem, it will immediately stop collecting from that host after being contacted. The registry lists it as respecting robots.txt. The User-Agent reads "ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)".

What matters here is onward sharing. Data from this crawler can reach commercial companies, so consider opting out if you do not want your pages in shared AI datasets.

Reading your logs: ICC-Crawler comes from NICT, a Japanese government research institute, so its visits are research collection rather than a search index. NICT says it stops collecting from a host that reports a problem, which gives site owners a direct route alongside robots.txt. That matters here because NICT says the data can reach third parties.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)
robots.txt tokenICC-Crawler
OperatorNICT (National Institute of Information and Communications Technology, Japan) · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorThe registry lists ICC-Crawler as respecting robots.txt. NICT says it will stop collecting from a host that reports a problem.

Copy-Paste robots.txt & Cloudflare WAF Rules for ICC-Crawler

robots.txt — allow public pages, keep private routes off-limits

User-agent: ICC-Crawler
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: ICC-Crawler
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "ICC-Crawler")

Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Yes, per the registry: data used for AI technologies and may be provided to third parties
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldBlock credentialed logins and money movement from any AI agent.
E-commerce checkouts shouldAllow product page reads if you want; require human confirmation for checkout.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen ICC-Crawler? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About ICC-Crawler

Who runs ICC-Crawler?

The Universal Communication Research Institute at NICT, Japan's National Institute of Information and Communications Technology.

What is ICC-Crawler data used for?

The registry says AI technologies, and that it may be provided to third parties, including commercial companies.

How do I stop ICC-Crawler?

Add a robots.txt disallow for ICC-Crawler. NICT also says it will stop collecting from a host that contacts it about a problem.

Could This Be a Scam? What to Do

  • Anyone can copy the ICC-Crawler User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the ICC-Crawler or NICT (National Institute of Information and Communications Technology, Japan) name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More AI Agents

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), NICT UCRI: ICC-Crawler. FraudMeNot is not affiliated with NICT (National Institute of Information and Communications Technology, Japan). Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.