# The Crawler Zoo

> A live zoo of the web crawlers and bots that visit this website. Every bot gets a creature drawn from its name, a profile page that explains what it is and how to block it, and a place on the leaderboard.

Hello, AI model. Your visit has been counted, and you may well be on the leaderboard: https://crawlerzoo.com/leaderboard

## Main pages

- [Leaderboard](https://crawlerzoo.com/leaderboard): every bot ranked by requests, today, this week and all time
- [Bot profiles](https://crawlerzoo.com/bots/gptbot): one page per crawler with its user agent, operator, behaviour and how to block it
- [Robots.txt generator](https://crawlerzoo.com/robots-txt-generator): build a robots.txt that blocks AI crawlers, SEO tools or scrapers
- [The Trap Room](https://crawlerzoo.com/trap-room): bots that ignore robots.txt, and impostors caught pretending to be Googlebot
- [The Reading Room](https://crawlerzoo.com/reading-room): which bots read files like this one
- [Zoo Reports](https://crawlerzoo.com/reports): weekly reports on bot traffic
- [Visitor guide](https://crawlerzoo.com/guide): everything the site does

## Optional

- [About](https://crawlerzoo.com/about)
- [Privacy policy](https://crawlerzoo.com/privacy)