All tags
Catalogue tag

#robots-parser

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

1 record
Tagged “robots-parser”Ranked by health index
PyPI
77Goodhealth index
scrapy/protego
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command Language★ 91↓ 22.3M/moAug 8, 2026
BSD-3-ClauseAug 8, 2026 · metrics 2.5.0