The Reading Room
Who reads
the rules?
Some bots read the house rules before they eat. Some read them and eat anyway. Most never read them at all. Every file below is real, and every read is recorded.
7species read robots.txt
0species read llms.txt
0species read ai.txt
1species read security.txt
The shelves
robots.txtThe house rules for crawlers. The only file most bots know about.7 species
llms.txtA plain-text map of the site, written for AI models.0 species
ai.txtWhat AI companies may use the site for.0 species
security.txtWho to tell about a security problem.1 species
humans.txtCredits for the people behind the site.0 species
ads.txtWhich companies may sell advertising here.5 species
sitemap.xmlA list of every page worth reading.2 species
The reading ledger
Reads over the last 30 days. A dash means never.
| Specimen | robots.txt | llms.txt | ai.txt | security.txt | humans.txt | ads.txt | sitemap.xml |
|---|---|---|---|---|---|---|---|
| Googlebot | 7 | — | — | — | — | 2 | 2 |
| Bingbot | 5 | — | — | — | — | — | 1 |
| python-requests | — | — | — | 2 | — | 1 | — |
| curl | — | — | — | — | — | 4 | — |
| FossickBot | 2 | — | — | — | — | — | — |
| AgentTrustBot | 1 | — | — | — | — | — | — |
| Applebot | 1 | — | — | — | — | — | — |
| ClaudeBot | 1 | — | — | — | — | — | — |
| Masked visitor | — | — | — | — | — | 1 | — |
| Googlebot (impostor) | — | — | — | — | — | 1 | — |
| Pandalytics | 1 | — | — | — | — | — | — |