Vol. I · Mon, 16 Nov 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
Plate CCCLXIII0x310EF0E9UNREAD
Kingdom Automata›Phylum HTTP›Order Scanners›Family Unidentified›Species llmstxtcrawler
Specimen file · The Feral Pit

llmstxtcrawler

Incertae sedis

What is llmstxtcrawler?

A self-declared bot that is not in the keepers' catalogue yet. It calls itself “llmstxtcrawler”. It is operated by Unknown and identifies itself as llmstxtcrawler.

Temperament: unknown. Recently arrived. The keepers are still taking notes.

Operator
Unknown
Conservation status
Has not read the rules
First seen
23 Oct 2026
Last seen
24 days ago
Visits today
0
This week
0
All time
4
Caught in the trap
Never

Nobody has adopted llmstxtcrawler yet. Adopt llmstxtcrawler: your name goes on a plaque on this page for a year.

llmstxtcrawler's food bowl

the bowl, as bots see it

The bowl is empty.

5 of 5 tokens left today
§ I.

Identification

Its full user-agent string, exactly as it arrives at the gate:

User-Agent
$ Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/135.0.0.0 Safari/537.36 llmstxtcrawler/1.0 (contact: llmstxt.rocks)

There is no operator to verify against. This name is what software calls itself when nobody gave it one.

Identity check · logged visits, last 30 days
IdentityNothing to check against

No operator stands behind this name, so there is nothing to check its visits against.

§ II.

How to block llmstxtcrawler

Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from llmstxtcrawler's next visit. Nothing else on your site needs to change.

robots.txt
# Block llmstxtcrawler from the whole site
User-agent: llmstxtcrawler
Disallow: /

Or let it visit but keep it away from part of the site:

# Let it in, but keep it out of one room
User-agent: llmstxtcrawler
Allow: /
Disallow: /members/
§ III.

Observed behaviour

Visits, last 30 dayspeak 4 / day, 23 Oct 2026
18 Oct 2026today
Diet · pages most often eaten
/.well-known/llms-full.md1
/.well-known/llms.md1
/llms-full.txt1
/llms.txt1
Visiting hours
00h – 11h12h – 23h

Most active around 08:00. Before the coffee is made.

robots.txt compliance
100.0%

Requested 0 disallowed pages out of 4 requests. Never read robots.txt.

Trap Room record
Clean

Has never followed the hidden link to /trap/. Either well trained or very lucky.

§ IV.

Where it comes from

Scripts and scanners run from wherever their owners rent a server. These are the networks behind the visits on file:

Networks · 1 on file, last 30 days
netcup GmbH AS197540100%
Countries
Germany DE100%

Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.

§ V.

Keeper's field notes

23 Oct 2026Visited 4 times in a single day. Keeper unable to establish why.
23 Oct 202608:21. Arrived without announcement. Consumed /.well-known/llms-full.md and /.well-known/llms.md. Departed.
23 Oct 2026First recorded at the gate. Entered in the register as Incertae sedis.
§ VI.

Questions site owners ask

Does llmstxtcrawler respect robots.txt?

We can't say yet. It has not fetched robots.txt here, and it has not touched a disallowed page either.

Will blocking llmstxtcrawler hurt my search rankings?

No. Nothing respectable will miss it.

How often does llmstxtcrawler visit?

Here, about 0 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.

Also in The Feral Pit