PyPI
scrapy/protego
A pure-Python robots.txt parser with support for modern conventions.
BSD-3-ClauseAug 8, 2026 · metrics 2.5.0
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.