AI Agent & Bot CheckOperator: Semrush

SemrushBot-OCOB: what it is and how to block or allow it

User-Agent token: SemrushBot-OCOB · Operator: Semrush · Category: Crawls your site for ContentShake AI tool

FraudMeNot Verdict

Listed AI Agent

SemrushBot-OCOB is the Semrush robot tied to its Content Toolkit. Semrush lists a separate robots.txt group for it, so a rule for the main SemrushBot does not cover it.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

Semrush publishes no IP blocks for its bots, so the token is a claim.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Yes.

Judgment Call · What You Should Do

Generally Low Risk on Public Pages — Verify Before Trusting

For everyday users: SemrushBot-OCOB fetches pages for a content tool. An email in its name demanding a fee is likely a scam.

For website owners & security teams: Add a SemrushBot-OCOB group if you want it blocked; the main SemrushBot rule won't apply.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

1

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Yes

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
SemrushBot-OCOB
FraudMeNot_Verdict
Listed AI Agent
Operator_Entity
Semrush
Agent_Category
Crawls your site for ContentShake AI tool
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Yes (per ai.robots.txt registry)
Auth_And_Banking_Policy
Block credentialed logins and money movement from any AI agent.
Recommended_Gatekeeper_Action
DISALLOW in its own group if you don't want Content Toolkit visits.
Canonical_Citation_URL
https://fraudmenot.com/bot/semrushbot-ocob/

What We Know About SemrushBot-OCOB

Semrush's bot page lists more than a dozen robots, one per product. SemrushBot-OCOB is listed against the Content Toolkit, the Semrush product for planning and writing content. Its visits relate to that toolkit's reports.

To keep it out, Semrush gives a dedicated group: User-agent: SemrushBot-OCOB followed by Disallow: /. That matters because robots.txt groups match on the token, so Disallow rules written for plain SemrushBot leave this one untouched.

Semrush asks site owners not to try blocking its robots by IP, saying it does not use consecutive IP blocks. In practice that leaves robots.txt as the control Semrush supports, plus a user-agent rule at a WAF.

Semrush also suggests creating an empty robots.txt if your server logs fill with file-not-found errors from its bots.

Two answers in Semrush's FAQ are worth knowing. Its bots stop crawling pages they find do not exist, but may keep trying a dead URL if other sites still link to it. And if a login or survey form on your site uses the GET method, the inputs end up in URLs that a crawler can request, so Semrush recommends switching such forms to POST.

Semrush also warns that after a site migration, for example from HTTP to HTTPS, you need to move robots.txt too, or its bots will not see your rules on the new address.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • SemrushBot-OCOB
robots.txt tokenSemrushBot-OCOB
OperatorSemrush · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorSemrush documents a SemrushBot-OCOB robots.txt group for blocking it.

Copy-Paste robots.txt & Cloudflare WAF Rules for SemrushBot-OCOB

robots.txt — allow public pages, keep private routes off-limits

User-agent: SemrushBot-OCOB
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: SemrushBot-OCOB
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "SemrushBot-OCOB")

Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Not stated by Semrush; it is listed for the Content Toolkit
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldBlock credentialed logins and money movement from any AI agent.
E-commerce checkouts shouldAllow product page reads if you want; require human confirmation for checkout.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen SemrushBot-OCOB? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About SemrushBot-OCOB

What is SemrushBot-OCOB for?

Semrush lists it for its Content Toolkit.

Does blocking SemrushBot block OCOB?

No; Semrush gives OCOB its own robots.txt group.

Can I block it by IP?

Semrush says not to, as it doesn't use consecutive IP blocks.

Could This Be a Scam? What to Do

  • Anyone can copy the SemrushBot-OCOB User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the SemrushBot-OCOB or Semrush name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More from Semrush

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Semrush: SemrushBot. FraudMeNot is not affiliated with Semrush. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.