AI Agent & Bot Comparison

GPTBot vs OAI-SearchBot vs ChatGPT-User: What Each One Does

Comparison Table (as of Nov. 16, 2026)

Botrobots.txt tokenWhat it doesDoes robots.txt control it?Official IP list
GPTBotGPTBotCrawls content that may be used to train OpenAI's generative AI foundation models.Yes. Disallowing GPTBot signals your content should not be used for training.gptbot.json
OAI-SearchBotOAI-SearchBotSurfaces websites in ChatGPT's search features.Yes. Opted-out sites are not shown in ChatGPT search answers (they can still appear as navigational links). OpenAI says changes take about 24 hours.searchbot.json
ChatGPT-UserChatGPT-UserVisits a page when a ChatGPT or Custom GPT user asks; also GPT Actions. Not an automatic crawler and not used to decide what appears in search.May not apply: OpenAI says these user-initiated actions may not follow robots.txt rules.chatgpt-user.json

Each robots.txt setting is independent: blocking GPTBot does not remove you from ChatGPT search. User-agent strings and versions can change; check OpenAI's page before relying on them.

robots.txt Examples

Opt out of training, stay in ChatGPT search

User-agent: GPTBot
Disallow: /

User-agent: OAI-SearchBot
Allow: /

Allow both training and search

User-agent: GPTBot
Allow: /

User-agent: OAI-SearchBot
Allow: /

Opt out of both (ChatGPT search answers will not show your site)

User-agent: GPTBot
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

These are examples, not a recommendation. Which bots to allow depends on whether you want training use, ChatGPT search visibility, or neither.

Source (checked Nov. 16, 2026): OpenAI, Overview of OpenAI Crawlers. FraudMeNot is not affiliated with OpenAI. General information, not security advice.

Which OpenAI bot does what

OpenAI lists four user agents in its crawler docs, and each does a different job: GPTBot (training), OAI-SearchBot (ChatGPT search), ChatGPT-User (fetches a page when a user asks) and OAI-AdsBot (checks ad landing pages) (Source 1). OpenAI says the robots.txt settings are independent of each other. For example, a site can allow OAI-SearchBot so it can appear in search results while disallowing GPTBot so its content isn't used for training (Source 1).

Each one is summarized below. For full user-agent strings, version notes and log tips, see that bot's own page in our AI agent and bot directory.

Bot What OpenAI says it's for What blocking it in robots.txt changes
GPTBot Crawling content that may be used to train OpenAI's generative AI foundation models Signals your content shouldn't be used for that training
OAI-SearchBot Surfacing sites in ChatGPT's search features Your site won't be shown in ChatGPT search answers, though it can still appear as a navigational link
ChatGPT-User Visiting pages for certain user actions in ChatGPT and Custom GPTs Limited effect: OpenAI says robots.txt rules may not apply to user-initiated actions
OAI-AdsBot Checking landing pages submitted as ads on ChatGPT OpenAI says it only visits pages submitted as ads

All descriptions are from Source 1, checked 2026-10-24.

GPTBot

GPTBot crawls content that may be used to train OpenAI's generative AI foundation models (Source 1). OpenAI describes its purpose as making those models "more useful and safe" (Source 1).

  • If you block it: OpenAI says disallowing GPTBot "indicates a site's content should not be used in training generative AI foundation models" (Source 1).
  • What blocking doesn't do: OpenAI treats each setting separately, so blocking GPTBot on its own isn't described as removing you from ChatGPT search. That's handled by OAI-SearchBot (Source 1).
  • OpenAI publishes GPTBot's IP addresses (Source 1).
  • Shared crawling: if your site allows both GPTBot and OAI-SearchBot, OpenAI says it may use the results from just one crawl for both purposes, to avoid duplicative crawling (Source 1).
  • More on this crawler: GPTBot user agent, IP list and robots.txt rules

OAI-SearchBot

OAI-SearchBot is the bot OpenAI uses to surface websites in ChatGPT's search features (Source 1).

  • If you block it: OpenAI says opted-out sites "will not be shown in ChatGPT search answers, though can still appear as navigational links" (Source 1).
  • Timing: OpenAI says it can take about 24 hours after a robots.txt change for its search systems to adjust (Source 1).
  • Log tip: OpenAI says the user-agent string's version number may change. When fetching robots.txt files, it may add a "robots.txt" marker to the string, which helps owners whose logs omit paths tell those requests apart (Source 1).
  • OpenAI recommends allowing OAI-SearchBot and requests from its published IP ranges if you want to appear in search results (Source 1).
  • More on this crawler: OAI-SearchBot and ChatGPT search visibility

ChatGPT-User

ChatGPT-User visits a page when a ChatGPT or Custom GPT user's request calls for it. It isn't an automatic web crawler (Source 1).

  • If you block it: OpenAI says that because these actions are initiated by a user, "robots.txt rules may not apply" (Source 1). ChatGPT users may also interact with external applications via GPT Actions, according to OpenAI (Source 1). OpenAI also says ChatGPT-User isn't used to decide whether content appears in Search, and points site owners to OAI-SearchBot for that (Source 1).
  • Our take: if you want to limit these visits, robots.txt alone may not be enough. Check the published IP list and your own server or firewall options, and verify any visit before you block it.
  • More on this fetcher: ChatGPT-User user agent and how to verify it

OAI-AdsBot

OAI-AdsBot checks that web pages submitted as ads on ChatGPT follow OpenAI's policies (Source 1). According to OpenAI, when an advertiser submits an ad, OpenAI may visit its landing page to ensure it complies (Source 1).

  • What it touches: OpenAI says it only visits pages submitted as ads. OpenAI may also use landing-page content to decide when an ad is relevant, and says this data isn't used to train generative AI foundation models (Source 1).
  • If you block it: OpenAI's docs don't say what happens to an ad whose landing page blocks OAI-AdsBot, so we don't guess here. If you run ChatGPT ads, check OpenAI's ad documentation.
  • More on this crawler: OAI-AdsBot and ChatGPT ad landing pages

Is that visitor really OpenAI?

Anyone can type "GPTBot" into a user agent. Check the IP address instead. OpenAI publishes separate IP lists for each of the four bots (Source 1). Match the visitor's IP against the right list. A user-agent claim that comes from an address outside that list isn't verified.

Our take: a visitor that claims to be an OpenAI bot but isn't on the matching list can't be verified as OpenAI. Treat it like any unknown visitor. If it's part of a scam, report it.

Sources

  1. OpenAI, "Overview of OpenAI Crawlers." https://developers.openai.com/api/docs/bots — accessed 2026-10-24. The page links to these IP lists: https://openai.com/gptbot.json, https://openai.com/searchbot.json, https://openai.com/chatgpt-user.json and https://openai.com/adsbot.json.

OpenAI, ChatGPT, GPTBot, OAI-SearchBot, ChatGPT-User and OAI-AdsBot are trademarks of OpenAI, used only to identify its crawlers. FraudMeNot is not affiliated with or endorsed by OpenAI.

Common Questions

What's the difference between GPTBot and OAI-SearchBot?

GPTBot crawls content that may be used to train OpenAI's foundation models. OAI-SearchBot surfaces sites in ChatGPT search. OpenAI says the two settings are independent (Source 1).

If I block GPTBot, will I disappear from ChatGPT search?

Not according to OpenAI. They describe the settings as independent: a site can allow OAI-SearchBot to appear in search results while disallowing GPTBot. Blocking GPTBot signals "don't use my content for training" (Source 1).

Does ChatGPT-User follow robots.txt?

OpenAI says that because ChatGPT-User actions are initiated by a user, robots.txt rules may not apply (Source 1).

How fast does a robots.txt change take effect for ChatGPT search?

OpenAI says it can take about 24 hours (Source 1).

How do I know a visit really came from OpenAI?

Match the visitor's IP against the list OpenAI publishes for that bot (Source 1).

What is OAI-AdsBot?

OpenAI says OAI-AdsBot validates the safety of web pages submitted as ads on ChatGPT. It only visits pages submitted as ads, and the data it collects isn't used to train generative AI foundation models (Source 1).

Disclaimer. General education only. FraudMeNot content is general educational and awareness material, not legal, financial, tax, compliance, or cybersecurity advice, and it is not a security service or assessment. No guarantee: content is provided "as is" without warranties; it may contain errors or become outdated, and crawler behavior and documentation can change. Check OpenAI's current documentation before changing your settings, and consult a qualified professional about your specific situation.

Affiliates/sponsors: none on this page. Questions or corrections: contact us