All tags
Catalogue tag

#web-crawlers

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

3 records
Tagged “web-crawlers”Ranked by health index
npm
83Excellenthealth index
omrilotan/isbot
🤖/👨‍🦰 Detect bots/crawlers/spiders using the user agent string
TypeScript · JavaScript★ 1,155↓ 102M/moAug 4, 2026
UnlicenseAug 4, 2026 · metrics 2.10.0
PyPI
73Goodhealth index
pip-install-python/dash-improve-my-llms
Automate page creation for an llms.txt, page.json and architecture.txt. Allow llms the ability to read and understand your dash applications pages.
Python★ 8↓ 2,907/moAug 20, 2026
MITAug 20, 2026 · metrics 2.10.0