All tags
Catalogue tag

#webcrawler

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

4 records
Tagged “webcrawler”Ranked by health index
NuGet
75Goodhealth index
JaCraig/Spidey
A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
C#★ 16Oct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
Packagist
41Weakhealth index
zorlan/skycaiji
蓝天采集器是一款开源免费的爬虫系统,仅需点选编辑规则即可采集数据,可运行在本地、虚拟主机或云服务器中,几乎能采集所有类型的网页,无缝对接各类CMS建站程序,免登录实时发布数据,全自动无需人工干预!是网页大数据采集软件中完全跨平台的云端爬虫系统
PHP★ 2,091Sep 14, 2026
Custom licenseSep 14, 2026 · metrics 2.10.0
—
33At Riskhealth index
spidersuite/SpiderSuite
SpiderSuite (web security crawler) releases, wiki and roadmap
Mixed★ 979Sep 20, 2026
No licenseSep 20, 2026 · metrics 2.10.0
Maven
23At Riskhealth index
ssssssss-team/spider-flow
新一代爬虫平台,以图形化方式定义爬虫流程,不写代码即可完成爬虫。
Java★ 11.4KAug 27, 2026
MITAug 27, 2026 · metrics 2.10.0