Vol. I · Mon, 16 Nov 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
The Reading Room

Who reads
the rules?

Some bots read the house rules before they eat. Some read them and eat anyway. Most never read them at all. Every file below is real, and every read is recorded.

78species read robots.txt
36species read llms.txt
22species read ai.txt
26species read security.txt

The shelves

robots.txtThe house rules for crawlers. The only file most bots know about.78 species
llms.txtA plain-text map of the site, written for AI models.36 species
ai.txtWhat AI companies may use the site for.22 species
security.txtWho to tell about a security problem.26 species
humans.txtCredits for the people behind the site.23 species
ads.txtWhich companies may sell advertising here.27 species
sitemap.xmlA list of every page worth reading.41 species

The reading ledger

Reads over the last 30 days. A dash means never.

Specimenrobots.txtllms.txtai.txtsecurity.txthumans.txtads.txtsitemap.xml
Googlebot
1,1177777722
Masked visitor
5029192792642
AhrefsBot
933323326
MJ12bot
96111111
ExaSearchBot
3626261321
DotBot
40111111
PetalBot (impostor)
9321332
ElevenlabsCrawler
11111114
CCBot
12111112
SERankingBacklinksBot
11111111
python-httpx script
4111111
Barkrowler
6366666—
axios script
1515—15151515
YouBot
561111—1
ibou-search
1333332—
PetalBot
7323—31
Sogou web spider
91111—2
LocalSearchEngine
811111—
PayMeMerchantBot
11—1111
OAI-SearchBot
140—111—1
Bingbot
668——1160
Unclassified automaton
261—2—12
curl command
14511——6
viorobot
44—44——
SiteCheckerBot
3——3—33
Amazonbot
—4—223—
SEOJuice-SearchBot
323131————
Applebot
841————1
Reflectionbot
33———22—
ChatGPT-User
321————
Googlebot (impostor)
1————11
Kaupr
11———1—
ClaudeBot
262—————263
facebookexternalhit
3661—————
SemrushBot
330—————2
CryptoOutreachBot
29217—————
YandexBot
87—————3
KeenableBot
52—————2
AiTxtChecker
23—23————
SitemapChecker
23—————23
ShapBot
16—————6
BrickBlueBot
99—————
BuobeBot
15—————1
DataForSeoBot
8—————2
HeadlessChrome
44—————
YandexBot (impostor)
7—————1
SealKeeperBot
3——1———
AgentReadinessScanner
2—————2
AgentServiceDirectoryMonitor
22—————
QlyzeBot
2—————2
SelamlyBot
2—————2
AwarioBot
3—————1
agent-index
2—————1
FindgBot
2—————1
TernCrawler
2—————1
AgentDrivesAgent
12—————
AgenticWebToolsChecker
11—————
KiroServer
11—————
NicheMinerBot
1————1—
AdsCrawlr
1————1—
hostio-bot
1————1—
ArnorBot
1—————1
PerplexityBot
120——————
WellknownBot
115——————
AzureAI-SearchBot
100——————
Walsh-Research
69——————
AgentIndexBot
49——————
Claude-User
44——————
DuckAssistBot
39——————
GPTBot
——————30
ClueWeb-Crawler
26——————
Qwantbot
25——————
Maps-bot
25——————
Bytespider
25——————
LlmTxtChecker
24——————
Twitterbot
24——————
YaK
24——————
T2Bot
23——————
RobotsChecker
23——————
BitsExplorerBot
23——————