VelenPublicWebCrawler
User-Agent token: VelenPublicWebCrawler · Operator: Velen · Category: Scrapes data for business data sets and machine learning mod
FraudMeNot Verdict
AI Data Collection Bot
Velen says the goal of its crawler is to build business datasets and machine learning models to better understand the web.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
No official IP list is published, so the User-Agent alone cannot prove the request is real.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Your Choice — Your Content May Be Collected for AI
For everyday users: VelenPublicWebCrawler is a data crawler. A crawler that fetches one page every two seconds has no reason to email you; ignore messages that use its name.
For website owners & security teams: Velen says its crawler fetches at most one page every two seconds and picks up robots.txt changes within a few hours. Disallow VelenPublicWebCrawler if you do not want your pages in its business datasets and ML models.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
VelenPublicWebCrawler- FraudMeNot_Verdict
- AI Data Collection Bot
- Operator_Entity
- Velen
- Agent_Category
- Scrapes data for business data sets and machine learning mod
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW or DISALLOW per your dataset policy; Velen says changes apply within a few hours.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/velenpublicwebcrawler/
What We Know About VelenPublicWebCrawler
VelenPublicWebCrawler is run by Velen, whose website doubles as the crawler's notice page. The ai.robots.txt registry quotes Velen's stated goal: to build business datasets and machine learning models to better understand the web.
Velen is specific about its crawl rate. Velen's page says the crawler "usually will never" crawl more than one page at a time, and no more than one page every two seconds. That is a light load compared with many crawlers in this directory.
Velen says that if you want to ban this crawler in particular, you should target the User-Agent VelenPublicWebCrawler in your robots.txt, and that it should pick up the change within a few hours. It also gives an engineering contact for bugs or feedback. The registry lists it as respecting robots.txt. The User-Agent is "VelenPublicWebCrawler (velen.io)".
A crawler with a clear purpose, a stated rate limit and a quick robots.txt pickup is one of the easier ones to manage. The decision is whether you want your pages in business datasets and machine learning models.
Reading your logs: Velen's stated pace is no more than one page every two seconds, so VelenPublicWebCrawler traffic far above that rate does not match Velen's own description. After you add a disallow, Velen says the crawler should notice within a few hours, so check your logs the next day rather than right away. Velen lists an engineering contact for bugs.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | VelenPublicWebCrawler |
| Operator | Velen · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | Velen says to target VelenPublicWebCrawler in robots.txt and that it picks up changes within a few hours. |
Copy-Paste robots.txt & Cloudflare WAF Rules for VelenPublicWebCrawler
robots.txt — allow public pages, keep private routes off-limits
User-agent: VelenPublicWebCrawler
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: VelenPublicWebCrawler
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "VelenPublicWebCrawler")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Yes: Velen says it builds business datasets and machine learning models |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen VelenPublicWebCrawler? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About VelenPublicWebCrawler
Who runs VelenPublicWebCrawler?
Velen, per its notice at velen.io.
How fast does VelenPublicWebCrawler crawl?
Velen says usually no more than one page at a time and one page every two seconds.
How do I block VelenPublicWebCrawler?
Velen says to target the User-Agent VelenPublicWebCrawler in robots.txt; it should pick up the change within a few hours.
How quickly does Velen honor a robots.txt change?
Velen says the crawler should pick up a change targeting VelenPublicWebCrawler within a few hours. Its page also lists an engineering contact for bugs or feedback.
Could This Be a Scam? What to Do
- Anyone can copy the VelenPublicWebCrawler User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the VelenPublicWebCrawler or Velen name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More AI Agents
- AddSearchBot — AI Search Crawlers
- adidxbot — Advertising quality crawler
- AgentDataBot — AI Data Providers
- AgentTimes — Data Scraper from RSS Feeds
- AGI Agent — AI Agents
- AhrefsBot — SEO crawler
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Velen: crawler notice. FraudMeNot is not affiliated with Velen. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.