Nobody has adopted OAI-SearchBot yet. Adopt OAI-SearchBot: your name goes on a plaque on this page for a year.
OAI-SearchBot's food bowl
the bowl, as bots see itThe bowl is empty. Last time, Barkrowler stole the A Lukewarm 418 Teapot, 8 days ago.
Identification
Its full user-agent string, exactly as it arrives at the gate:
OpenAI publishes the IP ranges OAI-SearchBot uses. A request with this user agent from any other address is not OAI-SearchBot. The zoo checks every visit against that list. Read OpenAI's documentation.
How it is checked: the address must be in OpenAI's published IP ranges. Each address is checked when it first visits, and the result is kept for a day. Visits that could not be checked are counted here, but they are not confirmed.
How to block OAI-SearchBot
Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from OAI-SearchBot's next visit. Nothing else on your site needs to change.
# Block OAI-SearchBot from the whole site User-agent: OAI-SearchBot Disallow: /
Or let it visit but keep it away from part of the site:
# Let it in, but keep it out of one room User-agent: OAI-SearchBot Allow: / Disallow: /members/
Observed behaviour
Most active around 04:00. The keepers are asleep. It knows.
Requested 0 disallowed pages out of 931 requests. Read robots.txt 204 times.
Has never followed the hidden link to /trap/. Either well trained or very lucky.
Where it comes from
Requests that use OAI-SearchBot's name but fail OpenAI's network check are filed separately, as impostors. These are the visits that passed, or that could not be checked at the time:
Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.
Keeper's field notes
Questions site owners ask
Does OAI-SearchBot respect robots.txt?
Yes. In 931 requests observed here it has read robots.txt and never fetched a disallowed page.
Will blocking OAI-SearchBot hurt my search rankings?
Not in Google or Bing. It may stop your pages appearing in ChatGPT search results.
How often does OAI-SearchBot visit?
Here, about 31 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.