Vol. I · Mon, 16 Nov 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
Plate XIII0x6A85CEA7MOSTLY
Kingdom Automata›Phylum HTTP›Order Crawlers›Family Search Engines›Species archive.org_bot
Specimen file · Search Engine Savanna

archive.org_bot

Memoria aeterna

What is archive.org_bot?

The Internet Archive's crawler. It saves copies of pages for the Wayback Machine. It is operated by Internet Archive and identifies itself as archive.org_bot.

Temperament: sentimental. Keeps a copy of everything, just in case. Has photographs of this page as a child.

Operator
Internet Archive
Conservation status
Selectively obedient
First seen
1 Oct 2026
Last seen
14 days ago
Visits today
0
This week
0
All time
981
Caught in the trap
2 times
AdoptedThis enclosure is supported by Mark Graham and Jen. Thank you.

Adopt archive.org_bot too: your name goes on a plaque on this page for a year.

archive.org_bot's food bowl

the bowl, as bots see it

The bowl is empty. Last time, Barkrowler stole the A Lukewarm 418 Teapot, 8 days ago.

5 of 5 tokens left today
§ I.

Identification

Its full user-agent string, exactly as it arrives at the gate:

User-Agent
$ Mozilla/5.0 (compatible; archive.org_bot +http://archive.org/details/archive.org_bot)

Internet Archive does not publish a way to verify archive.org_bot's traffic. Treat its user agent as a claim, not proof: anyone can send it. Read Internet Archive's documentation.

Identity check · logged visits, last 30 days
IdentityCannot be verified

Internet Archive publishes no way to check it, so every visit filed here is taken at its word.

§ II.

How to block archive.org_bot

Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from archive.org_bot's next visit. Nothing else on your site needs to change.

robots.txt
# Block archive.org_bot from the whole site
User-agent: archive.org_bot
Disallow: /

Or let it visit but keep it away from part of the site:

# Let it in, but keep it out of one room
User-agent: archive.org_bot
Allow: /
Disallow: /members/
§ III.

Observed behaviour

Visits, last 30 dayspeak 36 / day, 23 Oct 2026
18 Oct 2026today
Diet · pages most often eaten
/og/bots/mcpbeat.png2
/og/bots/imagesiftbot.png2
/og/bots/adsbot-google.png2
/og/bots/bitsexplorerbot.png2
/og/bots/clueweb-crawler.png2
Visiting hours
00h – 11h12h – 23h

Most active around 08:00. Before the coffee is made.

robots.txt compliance
87.5%

Requested 122 disallowed pages out of 981 requests. Read robots.txt 1 times.

Trap Room record
2×

Walked through the hidden /trap/ door. Last caught 20 days ago.

In the Labyrinth
Level 1,187

Opened 122 rooms in the endless maze. Watch it in the Labyrinth →

§ IV.

Where it comes from

The networks archive.org_bot's visits came from:

Networks · 1 on file, last 30 days
Internet Archive Canada AS399784100%
Countries
Canada CA100%

Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.

§ V.

Keeper's field notes

2 Nov 202613:08. Arrived without announcement. Consumed /og/bots/mcpbeat.png and /bots/mcpbeat. Departed.
27 Oct 2026Caught walking through /trap/. The sign on the door was very clear.
4 Oct 2026Visited 524 times in a single day. Keeper unable to establish why.
1 Oct 2026First recorded at the gate. Entered in the register as Memoria aeterna.
§ VI.

Questions site owners ask

Does archive.org_bot respect robots.txt?

Mostly. It reads robots.txt, but it has fetched a disallowed page 122 times out of 981 requests observed here.

Will blocking archive.org_bot hurt my search rankings?

Yes, for Internet Archive's search engine. Blocked pages can drop out of its results. Other search engines are unaffected.

How often does archive.org_bot visit?

Here, about 0 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.

Also in Search Engine Savanna