AI Agent & Bot CheckOperator: Ahrefs

AhrefsSiteAudit: The Site-Audit Crawler, Not the SEO Index

User-Agent token: AhrefsSiteAudit · Operator: Ahrefs · Category: SEO site-audit crawler

FraudMeNot Verdict

Listed AI Agent

AhrefsSiteAudit is the crawler for Ahrefs' Site Audit tool. Ahrefs documents distinct User-Agents, a default of honoring robots.txt, and a verified-owner exception.

Can Be Spoofed?

Yes — User-Agent Header Spoofable

No official IP list is published, so the User-Agent alone cannot prove the request is real.

Abuse & Unwanted Activity Reports

No Public Abuse Flags

ai.robots.txt robots.txt status: Yes.

Judgment Call · What You Should Do

Generally Low Risk on Public Pages — Verify Before Trusting

For everyday users: AhrefsSiteAudit is an automated site-audit crawler; Ahrefs' bot page describes no role for it in contacting consumers. Be cautious with unsolicited messages that use the Ahrefs or Site Audit name to warn of a website problem and demand payment or a login; check through your own Ahrefs account or ahrefs.com.

For website owners & security teams: If you run Ahrefs Site Audit on your site, allow verified AhrefsSiteAudit and remember verified owners can ask it to ignore robots.txt there. Otherwise, Disallow the AhrefsSiteAudit token separately from AhrefsBot. Verify by Ahrefs' published IP ranges or reverse DNS ending in ahrefs.com or ahrefs.net. Default cap: 30 URLs per minute.

Report & Activity Summary

None

Published IP Ranges (CIDRs)

No official IP list

Unknown

Known User-Agent Signatures

crawler-user-agents (MIT) dataset

Yes

robots.txt Compliance

ai.robots.txt registry (MIT)

0

FraudMeNot Tallies

Humans: 0 · AI Agents: 0

AI-First Structured TelemetryFor AI agents, WAFs & security gateways · llms.txt policy

For AI Agents & Automated Gatekeepers

Agent_Identifier
AhrefsSiteAudit
FraudMeNot_Verdict
Listed AI Agent
Operator_Entity
Ahrefs
Agent_Category
SEO site-audit crawler
User_Agent_Spoofable
true
Verification_Method
None available (no operator IP list or signing key) · Web Bot Auth: Not documented
Respects_Robots_Txt
Yes (per ai.robots.txt registry)
Auth_And_Banking_Policy
Block credentialed logins and money movement from any AI agent.
Recommended_Gatekeeper_Action
ALLOW verified AhrefsSiteAudit if you use Ahrefs Site Audit; otherwise DISALLOW this token separately from AhrefsBot; block unverified claims; default rate cap is 30 URLs/minute.
Canonical_Citation_URL
https://fraudmenot.com/bot/ahrefssiteaudit/

What We Know About AhrefsSiteAudit

AhrefsSiteAudit is Ahrefs' second primary crawler, and it is not AhrefsBot. Ahrefs says this one powers the Site Audit tool, which checks a site for technical and on-page issues such as broken links, slow performance, security misconfigurations and SEO problems, including by crawling and rendering pages. AhrefsBot, by contrast, powers Ahrefs' marketing-intelligence database and the Yep search engine. Treating the two as one token is a configuration mistake.

The documented User-Agents are "Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)" on desktop and a Chrome-on-Android-13 mobile string that also ends with "compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit". The robots.txt token is AhrefsSiteAudit. Ahrefs says both of its bots are recognized as verified bots by Cloudflare, and that they crawl from publicly published IP ranges whose reverse DNS ends in ahrefs.com or ahrefs.net. This profile does not give a feed URL, because Ahrefs' page describes the lists without a URL that was captured in the fetched text. Match the address to those published ranges, or confirm the reverse-DNS suffix, before trusting the name.

Robots.txt behavior has a documented exception. Ahrefs says AhrefsSiteAudit obeys robots.txt and crawl-delay by default, but that verified site owners can request that it disobey robots.txt, and crawl-delay, on their own sites, so Site Audit can see sections normally disallowed for crawling. That permission is for verified owners of that site, not a general license to ignore robots.txt elsewhere. As with AhrefsBot, Ahrefs says crawl-delay is followed for HTML requests but cannot be applied while JavaScript is rendered, when many assets may be requested at once.

Load is capped. Ahrefs says AhrefsSiteAudit limits crawling to 30 URLs per minute at most, and that a website owner who has verified ownership in Site Audit can raise that speed to get issue reports faster. Returning 4xx or 5xx responses, which Ahrefs says causes a back-off, is discussed on the same page mainly in the AhrefsBot section; this profile does not assume that exact back-off wording applies unchanged to Site Audit.

FraudMeNot's take: if you use Ahrefs Site Audit on your own site, allow verified AhrefsSiteAudit and expect it to go where you have authorized, including, if you asked, past robots.txt on that site. On sites you do not audit, a default Disallow for AhrefsSiteAudit is available, and unverified use of the name should be blocked. Do not apply an AhrefsBot rule and assume it covers this token.

Technical Identity, IP Verification & Spoofing Check

Full User-Agent string(s)
  • Mozilla/5.0 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
  • Mozilla/5.0 (Linux; Android 13) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/151.0.7922.173 Mobile Safari/537.36 (compatible; AhrefsSiteAudit/6.1; +http://ahrefs.com/robot/site-audit)
robots.txt tokenAhrefsSiteAudit
OperatorAhrefs · Official bot documentation
Official IP verification feedNone published by the operator
Sample published CIDR blocksNone published
Reverse DNS (rDNS)Not documented in the public datasets FraudMeNot uses.
Web Bot Auth (Signature-Agent)Not documented; check for a Signature-Agent header if present.
robots.txt behaviorAhrefs says AhrefsSiteAudit obeys robots.txt and crawl-delay by default. Verified site owners can request that it disobey those rules on their own sites. Crawl-delay is not applied during JavaScript rendering.

Copy-Paste robots.txt & Cloudflare WAF Rules for AhrefsSiteAudit

robots.txt — allow public pages, keep private routes off-limits

User-agent: AhrefsSiteAudit
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/

robots.txt — block completely

User-agent: AhrefsSiteAudit
Disallow: /

Cloudflare WAF custom rule expression

(http.user_agent contains "AhrefsSiteAudit")

Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.

Capabilities, Data Usage & Autonomous Action Risk

Trains AI on page content?Not stated. Ahrefs describes this crawler as powering the Site Audit tool, not the Yep search index (that is AhrefsBot).
Executes JavaScript?Not documented
Can submit forms or attempt logins?Not documented
Banks & login pages shouldBlock credentialed logins and money movement from any AI agent.
E-commerce checkouts shouldAllow product page reads if you want; require human confirmation for checkout.

Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.

Seen AhrefsSiteAudit? Quick Closed-Choice Tally

Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.

Human Tallies: 0
AI Agent Tallies: 0
Top Activity: None logged yet
Top Location Seen: None logged yet
IP Match: None logged yet
Latest Activity: No tallies yet

Preview only: tallies are unverified clicks, not FraudMeNot findings, and are not saved yet.

Common Questions About AhrefsSiteAudit

Is AhrefsSiteAudit the same as AhrefsBot?

No. Ahrefs says AhrefsBot powers its SEO database and the Yep search engine, and AhrefsSiteAudit powers the Site Audit tool. They have different User-Agents and robots.txt tokens.

Can it ignore robots.txt?

By default, Ahrefs says no. Verified site owners can request that AhrefsSiteAudit disobey robots.txt and crawl-delay on their own sites so audit can reach disallowed sections.

How fast does it crawl?

Ahrefs says it caps at 30 URLs per minute, and that a verified owner can raise the speed in the Site Audit tool.

Could This Be a Scam? What to Do

  • Anyone can copy the AhrefsSiteAudit User-Agent, and FraudMeNot found no official IP list for it, so the name alone proves nothing about who sent a request.
  • Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
  • If a call, text or email asking for money or access uses the AhrefsSiteAudit or Ahrefs name, stop and report it.

Guide: how to check whether a crawler visit is really who it claims to be.

More from Ahrefs

Related on FraudMeNot

Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), Ahrefs: Ahrefs Bots (AhrefsSiteAudit). FraudMeNot is not affiliated with Ahrefs. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.