AI Agent & Bot CheckOperator: Cloudflare

CloudflareBrowserRenderingCrawler: block or allow it

User-Agent token: CloudflareBrowserRenderingCrawler · Operator: Cloudflare · Category: AI Data Providers

FraudMeNot Verdict

Listed AI Agent

CloudflareBrowserRenderingCrawler is the fixed User-Agent of the /crawl endpoint in Cloudflare's Browser Run, which customers use to crawl a site from a start URL. Cloudflare says it respects robots.txt, including crawl-delay.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

The User-Agent is fixed. Cloudflare's bot detection ID for /crawl is 128292352.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Unclear.

Judgment Call · What You Should Do

Generally Low Risk on Public Pages — Verify Before Trusting

For everyday users: This is an automated crawler run by Cloudflare customers. A message in its name asking for payment is likely a scam.

For website owners & security teams: Use robots.txt or a Content-Signal line to refuse it, or a WAF rule on its User-Agent. Cloudflare says it does not bypass CAPTCHAs.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

1

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Unclear

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
CloudflareBrowserRenderingCrawler
FraudMeNot_Verdict
Listed AI Agent
Operator_Entity
Cloudflare
Agent_Category
AI Data Providers
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Unclear (not stated by the operator or the ai.robots.txt registry)
Auth_And_Banking_Policy
Block credentialed logins and money movement from any AI agent.
Recommended_Gatekeeper_Action
ALLOW or DISALLOW by robots.txt; set Content-Signal for AI uses.
Canonical_Citation_URL
https://fraudmenot.com/bot/cloudflarebrowserrenderingcrawler/

What We Know About CloudflareBrowserRenderingCrawler

Cloudflare's Browser Run product renders pages in a headless browser for its customers. Its /crawl endpoint takes a starting URL and works outward through sitemaps, page links or both. Every request it makes uses the User-Agent CloudflareBrowserRenderingCrawler/1.0, and Cloudflare says customers cannot change it on this endpoint.

Cloudflare says /crawl respects robots.txt directives, including crawl-delay. Where a site sets no crawl-delay, it waits 0.5 seconds between requests to the same domain. URLs it is told not to fetch come back to the customer marked disallowed.

It also honors Content Signals. A customer declares purposes such as search, ai-input or ai-train, and if your robots.txt sets a matching Content-Signal to no, Cloudflare rejects the crawl request with an error.

Cloudflare says Browser Run does not bypass CAPTCHAs, Turnstile or other bot protection, and that bot protection on a target site will apply to it. It assigns /crawl the bot detection ID 128292352.

The customer chooses how URLs are found with a source setting: all, which uses sitemaps and page links, sitemaps only, or links only. Cloudflare also tells people crawling their own Cloudflare-protected site that they can add a WAF skip rule to allowlist Browser Run, which is a reminder that the default bot protection may block it.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • CloudflareBrowserRenderingCrawler/1.0
robots.txt tokenCloudflareBrowserRenderingCrawler
OperatorCloudflare · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorCloudflare says the /crawl endpoint respects robots.txt, including crawl-delay, and Content Signals.

Copy-Paste robots.txt & Cloudflare WAF Rules for CloudflareBrowserRenderingCrawler

robots.txt — allow public pages, keep private routes off-limits

User-agent: CloudflareBrowserRenderingCrawler
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: CloudflareBrowserRenderingCrawler
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "CloudflareBrowserRenderingCrawler")

Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Depends on the customer; Cloudflare lets them declare search, ai-input or ai-train purposes
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldBlock credentialed logins and money movement from any AI agent.
E-commerce checkouts shouldAllow product page reads if you want; require human confirmation for checkout.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen CloudflareBrowserRenderingCrawler? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About CloudflareBrowserRenderingCrawler

Can a customer change its User-Agent?

Cloudflare says no for the /crawl endpoint.

Does it obey robots.txt?

Cloudflare says yes, including crawl-delay.

What are Content Signals?

robots.txt lines declaring search, ai-input or ai-train preferences; Cloudflare rejects conflicting crawls.

Could This Be a Scam? What to Do

  • Anyone can copy the CloudflareBrowserRenderingCrawler User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the CloudflareBrowserRenderingCrawler or Cloudflare name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More from Cloudflare

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Cloudflare Docs: Browser Run /crawl endpoint. FraudMeNot is not affiliated with Cloudflare. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.