Vol. I · Mon, 16 Nov 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
Plate XVII0x7D93F65CMOSTLY
Kingdom Automata›Phylum HTTP›Order Crawlers›Family AI Scrapers›Species ClaudeBot
Specimen file · The AI Aviary

ClaudeBot

Lector anthropicus

What is ClaudeBot?

Anthropic's web crawler. It collects public pages that may be used to train Anthropic's models. It is operated by Anthropic and identifies itself as ClaudeBot.

Temperament: polite. Reads the house rules first, every time. Has never been caught in the trap. The keepers find this suspicious.

Operator
Anthropic
Conservation status
Selectively obedient
First seen
2 Oct 2026
Last seen
0 s ago
Visits today
53
This week
198
All time
2,750
Caught in the trap
1 times

Nobody has adopted ClaudeBot yet. Adopt ClaudeBot: your name goes on a plaque on this page for a year.

ClaudeBot's food bowl

the bowl, as bots see it

The bowl is empty. Last time, MJ12bot stole the Lightly Salted Packet Loss Popcorn, 14 days ago.

5 of 5 tokens left today
§ I.

Identification

Its full user-agent string, exactly as it arrives at the gate:

User-Agent
$ Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)

Anthropic does not publish a way to verify ClaudeBot's traffic. Treat its user agent as a claim, not proof: anyone can send it.

Identity check · logged visits, last 30 days
IdentityCannot be verified

Anthropic publishes no way to check it, so every visit filed here is taken at its word.

§ II.

How to block ClaudeBot

Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from ClaudeBot's next visit. Nothing else on your site needs to change.

robots.txt
# Block ClaudeBot from the whole site
User-agent: ClaudeBot
Disallow: /

Anthropic also runs Claude-SearchBot (search) and Claude-User (user requests). Each has its own token.

Or let it visit but keep it away from part of the site:

# Let it in, but keep it out of one room
User-agent: ClaudeBot
Allow: /
Disallow: /members/
§ III.

Observed behaviour

Visits, last 30 dayspeak 129 / day, 24 Oct 2026
18 Oct 2026today
Diet · pages most often eaten
/adopt288
/sitemap.xml265
/robots.txt264
/og/home.png4
/2
Visiting hours
00h – 11h12h – 23h

Most active around 07:00. Before the coffee is made.

robots.txt compliance
88.9%

Requested 304 disallowed pages out of 2,750 requests. Read robots.txt 451 times.

Trap Room record
1×

Walked through the hidden /trap/ door.

In the Labyrinth
Level 1,158

Opened 304 rooms in the endless maze. Watch it in the Labyrinth →

§ IV.

Where it comes from

The networks ClaudeBot's visits came from:

Networks · 2 on file, last 30 days
Amazon.com, Inc. AS16509100%
netcup GmbH AS2149961%
Countries
United States US100%

Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.

§ V.

Keeper's field notes

16 Nov 202618:10. Arrived without announcement. Consumed /bots/disguised and /reading-room. Departed.
16 Nov 2026Observed reading robots.txt in full. Complied with every word.
3 Oct 2026Visited 313 times in a single day. Keeper unable to establish why.
2 Oct 2026First recorded at the gate. Entered in the register as Lector anthropicus.
§ VI.

Questions site owners ask

Does ClaudeBot respect robots.txt?

Mostly. It reads robots.txt, but it has fetched a disallowed page 304 times out of 2,750 requests observed here.

Will blocking ClaudeBot hurt my search rankings?

No. ClaudeBot isn't used by Google or Bing to rank pages. Blocking it only affects whether Anthropic collects your content.

How often does ClaudeBot visit?

Here, about 28 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.

Also in The AI Aviary