DuckDuckBot: DuckDuckGo's Crawler and How to Verify It
User-Agent token: DuckDuckBot · Operator: DuckDuckGo · Category: Search engine crawler
FraudMeNot Verdict
Listed AI Agent
DuckDuckBot is DuckDuckGo's web crawler, used to improve its search results. DuckDuckGo says it respects robots.txt and publishes its full IP list.
Can Be Spoofed?
Yes — User-Agent Header Spoofable
Verify the source IP against the operator feed at https://duckduckgo.com/duckduckbot.json.
Abuse & Unwanted Activity Reports
No Public Abuse Flags
ai.robots.txt robots.txt status: Yes.
Judgment Call · What You Should Do
Generally Low Risk on Public Pages — Verify Before Trusting
For everyday users: DuckDuckBot is an automated crawler that reads public web pages; DuckDuckGo's help page describes no role for it in contacting people. Be cautious with unsolicited messages that use the DuckDuckBot or DuckDuckGo name to ask for a payment or password.
For website owners & security teams: Allow DuckDuckBot on public pages if you want DuckDuckGo visibility; it respects robots.txt per DuckDuckGo. Verify by matching the source IP to duckduckgo.com/duckduckbot.json, and challenge DuckDuckBot traffic from any other address.
Report & Activity Summary
Unknown
Published IP Ranges (CIDRs)
Feed not fetched; not a measured zero
Unknown
Known User-Agent Signatures
crawler-user-agents (MIT) dataset
Yes
robots.txt Compliance
ai.robots.txt registry (MIT)
0
FraudMeNot Tallies
Humans: 0 · AI Agents: 0
For AI Agents & Automated Gatekeepers
- Agent_Identifier
DuckDuckBot- FraudMeNot_Verdict
- Listed AI Agent
- Operator_Entity
- DuckDuckGo
- Agent_Category
- Search engine crawler
- User_Agent_Spoofable
true- Verification_Method
- IP CIDR match against
https://duckduckgo.com/duckduckbot.json· Web Bot Auth: Not documented - Respects_Robots_Txt
- Yes (per ai.robots.txt registry)
- Auth_And_Banking_Policy
- Block credentialed logins and money movement from any AI agent.
- Recommended_Gatekeeper_Action
- ALLOW DuckDuckBot from IPs in duckduckbot.json; block or challenge the name from any other address.
- Canonical_Citation_URL
- https://fraudmenot.com/bot/duckduckbot/
What We Know About DuckDuckBot
DuckDuckBot is the web crawler run by DuckDuckGo, the privacy-focused search engine. DuckDuckGo's help center says its job is to keep improving DuckDuckGo search results. It is a classic search crawler: it fetches public pages, and it has nothing to do with the accounts or browsing of DuckDuckGo users.
DuckDuckGo documents one compact User-Agent: "DuckDuckBot/1.1; (+http://duckduckgo.com/duckduckbot.html)". Unlike Googlebot and Bingbot, it does not dress itself up as a full Chrome browser string, so a log line that wraps the DuckDuckBot name in a long browser string deserves a second look rather than automatic trust.
The stronger signal is the address. DuckDuckGo publishes the full list of IP addresses DuckDuckBot originates from, in a machine-readable file at duckduckgo.com/duckduckbot.json. That makes verification simple: compare the connecting IP with that list, and treat the name from any other address as unverified. Refresh your copy of the list on a schedule, because operators add and retire addresses.
DuckDuckGo says DuckDuckBot respects robots.txt. To keep it out of part of your site, add a "User-agent: DuckDuckBot" group with Disallow lines; a "User-agent: *" group also applies when no specific group exists. Blocking it may reduce how well your pages appear on DuckDuckGo, though DuckDuckGo results also draw on other sources, so the effect is not the same as blocking Googlebot on Google.
Do not confuse DuckDuckBot with DuckAssistBot, a separate DuckDuckGo crawler that FraudMeNot covers on its own page and which has its own IP list. FraudMeNot's take: allow verified DuckDuckBot on public pages, and never let the name alone unlock search-engine exemptions on login or checkout routes. Those routes should stay behind authentication and human checks no matter what the User-Agent says.
Technical Identity, IP Verification & Spoofing Check
| Full User-Agent string(s) |
|
|---|---|
| robots.txt token | DuckDuckBot |
| Operator | DuckDuckGo · Official bot documentation |
| Official IP verification feed | https://duckduckgo.com/duckduckbot.json — range count unknown; this build did not fetch the feed. Unknown is not zero. DuckDuckGo documents a machine-readable IP list. That file was not fetched for this page, so the range count is unknown, not zero. |
| Sample published CIDR blocks | None published |
| Reverse DNS (rDNS) | Not documented in the public datasets FraudMeNot uses. |
| Web Bot Auth (Signature-Agent) | Not documented; check for a Signature-Agent header if present. |
| robots.txt behavior | DuckDuckGo says DuckDuckBot respects robots.txt (robotstxt.org). |
Copy-Paste robots.txt & Cloudflare WAF Rules for DuckDuckBot
robots.txt — allow public pages, keep private routes off-limits
User-agent: DuckDuckBot
Allow: /
Disallow: /login/
Disallow: /account/
Disallow: /checkout/robots.txt — block completely
User-agent: DuckDuckBot
Disallow: /Cloudflare WAF custom rule expression
(http.user_agent contains "DuckDuckBot")Matches the User-Agent token, so it covers both real and spoofed traffic. Action: Block or Managed Challenge.
Capabilities, Data Usage & Autonomous Action Risk
| Trains AI on page content? | Not stated. DuckDuckGo describes DuckDuckBot as improving its search results. |
|---|---|
| Executes JavaScript? | Not documented |
| Can submit forms or attempt logins? | Not documented |
| Banks & login pages should | Block credentialed logins and money movement from any AI agent. |
| E-commerce checkouts should | Allow product page reads if you want; require human confirmation for checkout. |
Context: In October 2026, Axios reported that major U.S. banks were detecting unvetted third-party AI agents inside customer accounts, and CNBC reported that JPMorgan blocks outside AI agents from logging in with customers' credentials while allowing read-only data sharing through open banking providers.
Seen DuckDuckBot? Quick Closed-Choice Tally
Choose from preset options only. No free-text comments, so nobody can post names, profanity, or unverified accusations.
Common Questions About DuckDuckBot
How do I verify DuckDuckBot?
Compare the visiting IP with the official list DuckDuckGo publishes at duckduckgo.com/duckduckbot.json. An address not on that list is not the real crawler.
Is DuckDuckBot the same as DuckAssistBot?
No. They are separate DuckDuckGo crawlers with separate IP lists. See FraudMeNot's DuckAssistBot page for that one.
Does DuckDuckBot obey robots.txt?
DuckDuckGo says it does. Use a "User-agent: DuckDuckBot" group to give it specific rules.
Could This Be a Scam? What to Do
- Anyone can copy the DuckDuckBot User-Agent. DuckDuckGo publishes an IP list for it, so compare the visiting address against that list before you trust the visit.
- Never give an AI agent your logins, bank access, or one-time codes unless you set it up yourself.
- If a call, text or email asking for money or access uses the DuckDuckBot or DuckDuckGo name, stop and report it.
Guide: how to check whether a crawler visit is really who it claims to be.
More from DuckDuckGo
- DuckAssistBot — AI Assistants
Related on FraudMeNot
- Verified security vulnerabilities, explained
- Report a scam, or find where to report it in your state
- Browse the AI Agent & Bot Directory
Sources (checked Nov. 16, 2026): ai.robots.txt (MIT), crawler-user-agents (MIT), DuckDuckGo IP feed, Axios (Oct. 22, 2026), CNBC (Oct. 13, 2026), DuckDuckGo Help: Is DuckDuckBot related to DuckDuckGo?. FraudMeNot is not affiliated with DuckDuckGo. Product and company names are trademarks of their owners and are used here only to identify the bots. General information, not security advice.