AI Agent & Bot CheckOperator: ByteDance

Bytespider

User-Agent token: Bytespider · Operator: ByteDance · Category: LLM Training Scraper

FraudMeNot Verdict

High Caution — Aggressive Scraper

Operated by ByteDance (TikTok's parent). Downloads web data to train large language models.

Can Be Spoofed?

Yes — and Hard to Verify

ByteDance publishes no official IP range list or Web Bot Auth key, so a Bytespider User-Agent cannot be cryptographically or IP-verified.

Abuse & Unwanted Activity Reports

High Unwanted Scraping Reports

ai.robots.txt flags robots.txt respect: No. In July 2024, Cloudflare reported that Bytespider was blocked more often than any other top AI bot it tracked.

Judgment Call · What You Should Do

Block It at the Firewall — robots.txt Alone May Not Stop It

For everyday users: Everyday users do not need to do anything. Bytespider scrapes public websites; it does not call, text, or log into your accounts. Any message claiming to be from "Bytespider" or "ByteDance security" asking you to act is a scam.

For website owners & security teams: Add a robots.txt disallow as a courtesy, but because the public ai.robots.txt registry lists Bytespider as not respecting robots.txt, enforce a block with a WAF rule on the User-Agent and rate limits. There is no official IP list, so you cannot "verify" it; blocking the UA covers both real and spoofed traffic.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

19

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

No

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
Bytespider
FraudMeNot_Verdict
High Caution — Aggressive Scraper
Operator_Entity
ByteDance
Agent_Category
LLM Training Scraper
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: None — no Signature-Agent key directory published.
Respects_Robots_Txt
No (per ai.robots.txt registry)
Auth_And_Banking_Policy
Block outright on all routes.
Recommended_Gatekeeper_Action
BLOCK all requests with "Bytespider" in the User-Agent; apply rate limits to unverified mobile-Chrome crawl bursts.
Canonical_Citation_URL
https://fraudmenot.com/bot/bytespider/

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • Mozilla/5.0 (Linux; Android 5.0) AppleWebKit/537.36 (KHTML, like Gecko) Mobile Safari/537.36 (compatible; Bytespider; [email removed])
  • Mozilla/5.0 (iPhone; CPU iPhone OS 11_0 like Mac OS X) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/43.0.7597.1164 Mobile Safari/537.36; Bytespider;[email removed]

19 known User-Agent variants in the MIT-licensed crawler-user-agents dataset (randomized Chrome versions and device strings).

robots.txt tokenBytespider
OperatorByteDance
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented by ByteDance.
Web Bot Auth (Signature-Agent)None — no Signature-Agent key directory published.
robots.txt behaviorThe ai.robots.txt registry lists it as not respecting robots.txt. Use a WAF block rule to enforce.

Copy-Paste robots.txt & Cloudflare WAF Rules for Bytespider

robots.txt — block completely

User-agent: Bytespider
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "Bytespider")

Because no verified IP list exists, block on the User-Agent token. Action: Block.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Yes — LLM training data
Executes JavaScript?Spoofs mobile Chrome User-Agents; JavaScript execution undocumented
Can submit forms or attempt logins?No documented form submission or login activity
Banks & login pages shouldBlock outright on all routes.
E-commerce checkouts shouldBlock or heavily rate-limit; scraping can skew analytics and inflate bandwidth.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen Bytespider? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About Bytespider

What is Bytespider?

Bytespider is a web crawler operated by ByteDance, the parent company of TikTok, that downloads web content to train large language models.

Does Bytespider respect robots.txt?

The open-source ai.robots.txt registry lists Bytespider as not respecting robots.txt. Website owners who want to stop it generally add a firewall (WAF) rule that blocks its User-Agent.

Can I verify that Bytespider traffic is really from ByteDance?

Not reliably. ByteDance does not publish an official IP range file or Web Bot Auth signing key for Bytespider, so the User-Agent can be copied by anyone. Blocking the User-Agent stops both real and fake Bytespider traffic.

Could This Be a Scam? What to Do

  • Anyone can copy the Bytespider User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the Bytespider or ByteDance name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More AI Agents

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Cloudflare (July 2024). FraudMeNot is not affiliated with ByteDance. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.