AI Agent & Bot CheckOperator: Webz.io

omgili

User-Agent token: omgili · Operator: Webz.io · Category: Data is sold

FraudMeNot Verdict

Listed AI Agent

omgili is Webz.io's crawler. The registry says it feeds data APIs used by social listening firms, and that the data is also sold for research and LLM training.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

"omgili/0.5" links to omgili.com but there is no published address list, so the header alone cannot prove a request is from Webz.io.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Yes.

Judgment Call · What You Should Do

Generally Low Risk on Public Pages — Verify Before Trusting

For everyday users: omgili is a data company's crawler. It does not contact people. Ignore any message using the Omgili or Webz.io name to ask for payment.

For website owners & security teams: omgili collects forum, blog and news content that Webz.io sells via API, including, per the registry, for LLM training. Disallow it in robots.txt if you object; the registry lists it as respecting robots.txt.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

1

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Yes

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
omgili
FraudMeNot_Verdict
Listed AI Agent
Operator_Entity
Webz.io
Agent_Category
Data is sold
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Yes (per ai.robots.txt registry)
Auth_And_Banking_Policy
Data-resale crawlers have no reason to reach account areas; block them on authenticated routes.
Recommended_Gatekeeper_Action
ALLOW or DISALLOW per your data-resale policy; data may be sold for LLM training, per the registry.
Canonical_Citation_URL
https://fraudmenot.com/bot/omgili/

What We Know About omgili

omgili is the crawler of Webz.io, a company that sells web data through APIs for news, blogs, forums and archived content. The ai.robots.txt registry says it crawls sites for APIs used by companies such as Hootsuite, Sprinklr and NetBase, and that the data is also sold for research or LLM training.

Webz.io published a blog post on December 28, 2017 titled "What is the Omgili Bot, and why is it Crawling Your Website?". In it, Webz.io calls Omgili a white-hat web crawler used by major companies. That is the company's own description.

The User-Agent in our dataset reads "omgili/0.5 +http://omgili.com". The registry lists omgili as respecting robots.txt. FraudMeNot found no IP list for it.

Our take: the deciding factor is resale. Data collected by omgili can be sold to many buyers, including for AI training. If your forum or blog does not want that, a robots.txt disallow for omgili is the documented route.

For forum owners: discussion threads are what omgili was built around. Your members wrote that content, so decide (and consider telling them) whether you allow it to be sold onward through data APIs.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • omgili/0.5 +http://omgili.com
robots.txt tokenomgili
OperatorWebz.io · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorThe ai.robots.txt registry lists robots.txt respect as: Yes.

Copy-Paste robots.txt & Cloudflare WAF Rules for omgili

robots.txt — allow public pages, keep private routes off-limits

User-agent: omgili
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: omgili
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "omgili")

Blocks any request containing "omgili". Use this only if you also want to stay out of Webz.io data feeds.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Possibly: the registry says the data is sold for research purposes or LLM training
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldData-resale crawlers have no reason to reach account areas; block them on authenticated routes.
E-commerce checkouts shouldProduct reviews and forum threads are typical targets; decide whether you want them resold.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen omgili? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About omgili

Who runs omgili?

Webz.io, a web data company. Its blog explains the bot's origin and use.

What happens to data omgili collects?

The registry says it powers APIs used by social listening firms and is also sold for research or LLM training.

Does omgili respect robots.txt?

The ai.robots.txt registry lists it as respecting robots.txt.

Could This Be a Scam? What to Do

  • Anyone can copy the omgili User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the omgili or Webz.io name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More from Webz.io

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Webz.io: What is the Omgili bot?. FraudMeNot is not affiliated with Webz.io. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.