Vol. I · Mon, 16 Nov 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
Plate XVIII0x38FFB18FFERAL
Kingdom Automata›Phylum HTTP›Order Crawlers›Family AI Scrapers›Species Claude-SearchBot
Specimen file · The AI Aviary

Claude-SearchBot

Lector quaerens

What is Claude-SearchBot?

Anthropic's search crawler. It indexes pages to improve search results in Claude. It is operated by Anthropic and identifies itself as Claude-SearchBot.

Temperament: thorough. Takes notes in the margins. Cites its sources. Tidies up after itself.

Operator
Anthropic
Conservation status
Feral
First seen
3 Oct 2026
Last seen
6 days ago
Visits today
0
This week
1
All time
29
Caught in the trap
Never

Nobody has adopted Claude-SearchBot yet. Adopt Claude-SearchBot: your name goes on a plaque on this page for a year.

Claude-SearchBot's food bowl

the bowl, as bots see it

The bowl is empty. Last time, DotBot stole the Bot Chow (Original Recipe), 17 days ago.

5 of 5 tokens left today
§ I.

Identification

Its full user-agent string, exactly as it arrives at the gate:

User-Agent
$ Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Claude-SearchBot/1.0; +Claude-SearchBot@anthropic.com)

Anthropic does not publish a way to verify Claude-SearchBot's traffic. Treat its user agent as a claim, not proof: anyone can send it.

Identity check · logged visits, last 30 days
IdentityCannot be verified

Anthropic publishes no way to check it, so every visit filed here is taken at its word.

§ II.

How to block Claude-SearchBot

Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from Claude-SearchBot's next visit. Nothing else on your site needs to change.

robots.txt
# Block Claude-SearchBot from the whole site
User-agent: Claude-SearchBot
Disallow: /

Or let it visit but keep it away from part of the site:

# Let it in, but keep it out of one room
User-agent: Claude-SearchBot
Allow: /
Disallow: /members/
§ III.

Observed behaviour

Visits, last 30 dayspeak 1 / day, 10 Nov 2026
18 Oct 2026today
Diet · pages most often eaten
/1
Visiting hours
00h – 11h12h – 23h

Most active around 14:00. Office hours, like a professional.

robots.txt compliance
3.4%

Requested 28 disallowed pages out of 29 requests. Never read robots.txt.

Trap Room record
Clean

Has never followed the hidden link to /trap/. Either well trained or very lucky.

In the Labyrinth
Level 1,123

Opened 28 rooms in the endless maze. Watch it in the Labyrinth →

§ IV.

Where it comes from

The networks Claude-SearchBot's visits came from:

Networks · 1 on file, last 30 days
netcup GmbH AS214996100%
Countries
United States US100%

Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.

§ V.

Keeper's field notes

10 Nov 202614:36. Arrived without announcement. Consumed /. Departed.
3 Oct 2026First recorded at the gate. Entered in the register as Lector quaerens.
3 Oct 2026Visited 28 times in a single day. Keeper unable to establish why.
§ VI.

Questions site owners ask

Does Claude-SearchBot respect robots.txt?

No. It has never requested robots.txt here, and it has fetched disallowed pages 28 times.

Will blocking Claude-SearchBot hurt my search rankings?

Not in Google or Bing. It may stop your pages appearing in Claude's search results.

How often does Claude-SearchBot visit?

Here, about 0 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.

Also in The AI Aviary