npm · PyPI · Go
AlphaTechini/doc-fetch
Dynamic documentation fetching CLI that converts entire documentation sites to single markdown files for AI/LLM consumption
Sin licencia14 sept 2026 · métricas 2.10.0
Todas las etiquetas
Etiqueta del catálogo
#crawler
Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.
114 registros
Packagist
crawlbase/crawlbase-php
A lightweight, dependency free PHP class that acts as wrapper for Crawlbase API
Apache-2.08 sept 2026 · métricas 2.10.0
crates.io
zekroTJA/r34-crawler
A simple CLI tool to fetch and download images from rule34.xxx
MIT13 sept 2026 · métricas 2.10.0
Packagist
zorlan/skycaiji
蓝天采集器是一款开源免费的爬虫系统，仅需点选编辑规则即可采集数据，可运行在本地、虚拟主机或云服务器中，几乎能采集所有类型的网页，无缝对接各类CMS建站程序，免登录实时发布数据，全自动无需人工干预！是网页大数据采集软件中完全跨平台的云端爬虫系统
Licencia propia14 sept 2026 · métricas 2.10.0
npm
pavlealeksic/playwright-afp
Stop website fingerprinting techniques playwright edition
MIT21 oct 2026 · métricas 2.10.0
npm · crates.io · Go +2
ydyyes123/webpipe_sdk
El repositorio no publica descripción.
MIT20 sept 2026 · métricas 2.10.0
PyPI
bitextor/bitextor
Bitextor generates translation memories from multilingual websites
GPL-3.012 sept 2026 · métricas 2.10.0
npm
crawlbase/crawlbase-node
Fast dependency free library for Crawlbase API
Apache-2.011 sept 2026 · métricas 2.10.0
PyPI
lncrawl/lightnovel-crawler
Generate and download e-books from online sources.
GPL-3.011 sept 2026 · métricas 2.10.0
PyPI
scrapy/scrapy
Scrapy, a fast high-level web crawling & scraping framework for Python.
BSD-3-Clause17 sept 2026 · métricas 2.10.0
npm
thecodrr/fdir
⚡ The fastest directory crawler & globbing library for NodeJS. Crawls 1m files in < 1s
MIT16 sept 2026 · métricas 2.10.0
NuGet
SoftCircuits/HtmlMonkey
Lightweight HTML/XML parser written in C#.
Licencia propia15 sept 2026 · métricas 2.10.0
—
spidersuite/SpiderSuite
SpiderSuite (web security crawler) releases, wiki and roadmap
Sin licencia20 sept 2026 · métricas 2.10.0
npm
Floryvibla/linkedin-api-voyager
El repositorio no publica descripción.
Sin licencia18 sept 2026 · métricas 2.10.0
npm
trybyte-app/robotstxt-ts-port
Google's robots.txt parser ported to TypeScript - RFC 9309 compliant
Apache-2.011 oct 2026 · métricas 2.10.0
NuGet
aemarco/aemarcoCore
Some adult wallpaper stuff
Sin licencia4 oct 2026 · métricas 2.10.0
Maven
code4craft/webmagic
A scalable web crawler framework for Java.
Apache-2.027 ago 2026 · métricas 2.10.0
Go
Synoppy/synoppy-go
Official Go SDK for Synoppy — the web-data layer for AI agents. Read, crawl, map, extract, classify & enrich any website on one key. Standard library only.
MIT14 sept 2026 · métricas 2.10.0
npm
hardbulls/wbsc-crawler
El repositorio no publica descripción.
Sin licencia13 sept 2026 · métricas 2.10.0
Maven
ssssssss-team/spider-flow
新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。
MIT27 ago 2026 · métricas 2.10.0
PyPI
0-EternalJunior-0/GraphCrawler
Python бібліотека для сканування веб-сайтів та побудови графу їх структури.
MIT1 ago 2026 · métricas 2.10.0
npm
karthikuj/sasori
Sasori is a dynamic web crawler powered by Puppeteer, designed for lightning-fast endpoint discovery.
MIT16 sept 2026 · métricas 2.10.0
PyPI
apify/apify-shared-python
Constants and utilities shared across Apify's Python libraries and projects.
Apache-2.012 oct 2026 · métricas 2.10.0
npm · PyPI
88899/gitmen-lottery
彩票 数据 双色球 大乐透 快开 超级大乐透 预测 仅供学习
Sin licencia14 sept 2026 · métricas 2.10.0