omgili
User-Agent token: omgili · Operator: Webz.io · Category: Data is sold
FraudMeNot Verdict
Listed AI Agent
omgili is Webz.io's crawler. The registry says it feeds data APIs used by social listening firms, and that the data is also sold for research and LLM training.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
"omgili/0.5" links to omgili.com but there is no published address list, so the header alone cannot prove a request is from Webz.io.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Generally Low Risk on Public Pages — Verify Before Trusting
For everyday users: omgili is a data company's crawler. It does not contact people. Ignore any message using the Omgili or Webz.io name to ask for payment.
For website owners & security teams: omgili collects forum, blog and news content that Webz.io sells via API, including, per the registry, for LLM training. Disallow it in robots.txt if you object; the registry lists it as respecting robots.txt.
Report & Activity Summary
None
Published IP Ranges (CIDRs)
No official IP list
1
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
omgili- FraudMeNot_Verdict
- Listed AI Agent
- Operator_Entity
- Webz.io
- Agent_Category
- Data is sold
- User_Agent_Spoofable
true- Verification_Method
- None available (no operator IP list or signing key) · Web Bot Auth: Not documented
- Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Data-resale crawlers have no reason to reach account areas; block them on authenticated routes.
- Recommended_Gatekeeper_Action
- ALLOW or DISALLOW per your data-resale policy; data may be sold for LLM training, per the registry.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/omgili/
What We Know About omgili
omgili is the crawler of Webz.io, a company that sells web data through APIs for news, blogs, forums and archived content. The ai.robots.txt registry says it crawls sites for APIs used by companies such as Hootsuite, Sprinklr and NetBase, and that the data is also sold for research or LLM training.
Webz.io published a blog post on December 28, 2017 titled "What is the Omgili Bot, and why is it Crawling Your Website?". In it, Webz.io calls Omgili a white-hat web crawler used by major companies. That is the company's own description.
The User-Agent in our dataset reads "omgili/0.5 +http://omgili.com". The registry lists omgili as respecting robots.txt. FraudMeNot found no IP list for it.
Our take: the deciding factor is resale. Data collected by omgili can be sold to many buyers, including for AI training. If your forum or blog does not want that, a robots.txt disallow for omgili is the documented route.
For forum owners: discussion threads are what omgili was built around. Your members wrote that content, so decide (and consider telling them) whether you allow it to be sold onward through data APIs.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | omgili |
| Operator | Webz.io · Official bot documentation |
| Official IP verification feed | None published by the operator |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | The ai.robots.txt registry lists robots.txt respect as: Yes. |
Copy-Paste robots.txt & Cloudflare WAF Rules for omgili
robots.txt — allow public pages, keep private routes off-limits
User-agent: omgili
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: omgili
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "omgili")Blocks any request containing "omgili". Use this only if you also want to stay out of Webz.io data feeds.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Possibly: the registry says the data is sold for research purposes or LLM training |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Data-resale crawlers have no reason to reach account areas; block them on authenticated routes. |
| E-commerce checkouts should | Product reviews and forum threads are typical targets; decide whether you want them resold. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen omgili? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About omgili
Who runs omgili?
Webz.io, a web data company. Its blog explains the bot's origin and use.
What happens to data omgili collects?
The registry says it powers APIs used by social listening firms and is also sold for research or LLM training.
Does omgili respect robots.txt?
The ai.robots.txt registry lists it as respecting robots.txt.
Could This Be a Scam? What to Do
- Anyone can copy the omgili User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the omgili or Webz.io name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from Webz.io
- omgilibot — Data is sold
- Webzio-Extended — AI Data Scrapers
- AddSearchBot — AI Search Crawlers
- adidxbot — Advertising quality crawler
- AgentDataBot — AI Data Providers
- AgentTimes — Data Scraper from RSS Feeds
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Webz.io: What is the Omgili bot?. FraudMeNot is not affiliated with Webz.io. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.