Vol. I · Fri, 23 Oct 2026Open 24 hours · Feeding: continuous · Please do not tap the glassPatrons☕ Keepers' coffee
Plate CXII0x72E6AF68OBEYED
Kingdom Automata›Phylum HTTP›Order Crawlers›Family SEO Crawlers›Species NetAPI
Specimen file · SEO Swamp

NetAPI

Dominus indagator

What is NetAPI?

The crawler for NetAPI, a domain data service. It reads only a site’s home page, at most twice a month, for domain research and to enrich its datasets. It is operated by NetAPI and identifies itself as NetAPI.

Temperament: brief. Reads the front page twice a month and considers itself informed.

Operator
NetAPI
Conservation status
Respects robots.txt
First seen
2 Oct 2026
Last seen
17 h ago
Visits today
0
This week
2
All time
10
Caught in the trap
Never

Nobody has adopted NetAPI yet. Adopt NetAPI: your name goes on a plaque on this page for a year.

NetAPI's food bowl

the bowl, as bots see it

The bowl is empty.

5 of 5 tokens left today
§ I.

Identification

Its full user-agent string, exactly as it arrives at the gate:

User-Agent
$ NetAPI/1.1 (+https://netapi.com/bot.html)

To check a visitor really is NetAPI, run a reverse DNS lookup on its IP address and confirm the hostname ends in .bot.netapi.com. Then run a forward lookup on that hostname and check it returns the same IP. Anything that fails is an impostor; the zoo checks every visit this way and files the failures in the Trap Room. Read NetAPI's documentation.

Identity check · logged visits, last 30 days
Verified0
Could not be checked (lookup timed out)10
Failed: filed as an impostor0

How it is checked: its reverse DNS must end in .bot.netapi.com and resolve back to the same address. Each address is checked when it first visits, and the result is kept for a day. Visits that could not be checked are counted here, but they are not confirmed.

§ II.

How to block NetAPI

Add these two lines to the robots.txt file at the root of your site. Well-behaved crawlers read it before they crawl, so the change applies from NetAPI's next visit. Nothing else on your site needs to change.

robots.txt
# Block NetAPI from the whole site
User-agent: NetAPI
Disallow: /

NetAPI follows robots.txt (RFC 9309).

Or let it visit but keep it away from part of the site:

# Let it in, but keep it out of one room
User-agent: NetAPI
Allow: /
Disallow: /members/
§ III.

Observed behaviour

Visits, last 30 dayspeak 2 / day
24 Sept 2026today
Diet · pages most often eaten
/4
/robots.txt3
/arena/live2
/arena1
Visiting hours
00h – 11h12h – 23h

Most active around 21:00. After dark, like a burglar.

robots.txt compliance
100.0%

Requested 0 disallowed pages out of 10 requests. Read robots.txt 3 times.

Trap Room record
Clean

Has never followed the hidden link to /trap/. Either well trained or very lucky.

§ IV.

Where it comes from

Requests that use NetAPI's name but fail NetAPI's network check are filed separately, as impostors. These are the visits that passed, or that could not be checked at the time:

Networks · 2 on file, last 30 days
Hetzner Online GmbH AS2494060%
Google LLC AS1516940%
Countries
Germany DE60%
United States US40%

Networks and countries come from the visitor's IP address, looked up in a local copy of the DB-IP database. The addresses themselves are never stored.

§ V.

Keeper's field notes

22 Oct 202615:26. Arrived without announcement. Consumed / and /robots.txt. Departed.
22 Oct 2026Observed reading robots.txt in full. Complied with every word.
2 Oct 2026First recorded at the gate. Entered in the register as Dominus indagator.
2 Oct 2026Visited 2 times in a single day. Keeper unable to establish why.
§ VI.

Questions site owners ask

Does NetAPI respect robots.txt?

Yes. In 10 requests observed here it has read robots.txt and never fetched a disallowed page.

Will blocking NetAPI hurt my search rankings?

No. SEO crawlers build tools for marketers. Blocking them hides your links from those tools, not from search engines.

How often does NetAPI visit?

Here, about 0 requests a day over the last week. Visits to your site depend on its size, how often it changes, and how many links point to it.

Also in SEO Swamp