AI Agent & Bot CheckOperator: Panscient

panscient.com: what it is and how to block or allow it

User-Agent token: panscient.com · Operator: Panscient · Category: Data collection and analysis using machine learning and AI

FraudMeNot Verdict

Listed AI Agent

panscient.com is the production crawler of Panscient, which builds web datasets. Panscient says it obeys the Robot Exclusion Standard and makes at most one request per second per domain.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

The FAQ lists a contact email for crawler questions but no address ranges; the header by itself is only a claim.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Yes.

Judgment Call · What You Should Do

Generally Low Risk on Public Pages — Verify Before Trusting

For everyday users: Panscient's crawler fetches pages for datasets. If someone uses that name to ask you for account access, treat it as a probable scam.

For website owners & security teams: Block both panscient.com and pantest in robots.txt to opt out, as Panscient shows. Expect at most one request per second per domain, per Panscient.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

1

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Yes

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
panscient.com
FraudMeNot_Verdict
Listed AI Agent
Operator_Entity
Panscient
Agent_Category
Data collection and analysis using machine learning and AI
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Yes (per ai.robots.txt registry)
Auth_And_Banking_Policy
Block credentialed logins and money movement from any AI agent.
Recommended_Gatekeeper_Action
ALLOW or DISALLOW per your dataset policy; block pantest too.
Canonical_Citation_URL
https://fraudmenot.com/bot/panscient-com/

What We Know About panscient.com

Panscient's crawler FAQ says the production crawler identifies itself with the user agent panscient.com, and a separate testing crawler uses pantest. Panscient refreshes its full corpus quarterly and can deliver defined datasets as often as daily.

Panscient says the crawler finds sites mainly from Verisign's public list of registered .com domains, plus links between pages. That explains why it may visit a small site with few inbound links, and why it may request URLs that no longer exist: it follows links it found elsewhere.

On load, Panscient says the crawler makes at most one request per second to any single domain, and typically far fewer.

To opt out, Panscient gives a robots.txt example covering both crawlers: User-agent: panscient.com and User-agent: pantest, each with Disallow: /. It publishes no IP list on the FAQ, so the name alone cannot confirm a visit.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • panscient.com
  • pantest (testing crawler)
robots.txt tokenpanscient.com
OperatorPanscient · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorPanscient says its crawler obeys the Robot Exclusion Standard and gives robots.txt groups for panscient.com and pantest.

Copy-Paste robots.txt & Cloudflare WAF Rules for panscient.com

robots.txt — allow public pages, keep private routes off-limits

User-agent: panscient.com
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: panscient.com
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "panscient.com")

Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Not stated by Panscient
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldBlock credentialed logins and money movement from any AI agent.
E-commerce checkouts shouldAllow product page reads if you want; require human confirmation for checkout.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen panscient.com? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About panscient.com

What user agent does Panscient use?

Panscient says production uses panscient.com and testing uses pantest.

How fast does it crawl?

At most one request per second per domain, Panscient says.

Why does it request missing pages?

Panscient says it follows links found elsewhere, including links to URLs that no longer exist.

Could This Be a Scam? What to Do

  • Anyone can copy the panscient.com User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the panscient.com or Panscient name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More AI Agents

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Panscient: Crawler FAQ. FraudMeNot is not affiliated with Panscient. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.