All tags
Catalogue tag

#web-crawlers

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

3 records
Tagged “web-crawlers”Ranked by health index
PyPI
94Exceptionalhealth index
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Python★ 31KSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
npm
86Excellenthealth index
omrilotan/isbot
🤖/👨‍🦰 Detect bots/crawlers/spiders using the user agent string
TypeScript · JavaScript★ 1,160↓ 98.8M/moSep 16, 2026
UnlicenseSep 16, 2026 · metrics 2.10.0
PyPI
69Goodhealth index
pip-install-python/dash-improve-my-llms
Automate page creation for an llms.txt, page.json and architecture.txt. Allow llms the ability to read and understand your dash applications pages.
Python★ 8↓ 1,085/moOct 19, 2026
MITOct 19, 2026 · metrics 2.10.0