All tags
Catalogue tag

#robots-parser

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

2 records
Tagged “robots-parser”Ranked by health index
PyPI
86Excellenthealth index
scrapy/protego
A pure-Python robots.txt parser with support for modern conventions.
DIGITAL Command Language★ 95↓ 6.3M/moSep 17, 2026
BSD-3-ClauseSep 17, 2026 · metrics 2.10.0
npm
30At Riskhealth index
trybyte-app/robotstxt-ts-port
Google's robots.txt parser ported to TypeScript - RFC 9309 compliant
TypeScript★ 2↓ 14.9K/moOct 11, 2026
Apache-2.0Oct 11, 2026 · metrics 2.10.0