Todas las etiquetas
Etiqueta del catálogo

#crawl

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

22 registros
Con la etiqueta «crawl»Ordenado por índice de salud
crates.io · npm · PyPI
91Excelenteíndice de salud
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1095↓ 10.6K/mes2 oct 2026
AGPL-3.02 oct 2026 · métricas 2.10.0
crates.io · npm · PyPI
91Excelenteíndice de salud
us/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1032↓ 10.7K/mes16 sept 2026
AGPL-3.016 sept 2026 · métricas 2.10.0
PyPI
86Excelenteíndice de salud
ZenRows/zenrows-python-sdk
SDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/mes16 oct 2026
MIT16 oct 2026 · métricas 2.10.0
PyPI
81Excelenteíndice de salud
ScrapingBee/scrapingbee-cli
El repositorio no publica descripción.
Python★ 107↓ 350/mes15 sept 2026
MIT15 sept 2026 · métricas 2.10.0
Packagist
81Excelenteíndice de salud
chrome-php/chrome
Instrument headless chrome/chromium instances from PHP
PHP★ 2677↓ 314.5K/mes8 sept 2026
MIT8 sept 2026 · métricas 2.10.0
npm
80Excelenteíndice de salud
tavily-ai/tavily-n8n-node
A node for n8n that integrates the Tavily API, enabling powerful web search and content extraction within your no-code automation workflows.
TypeScript★ 21↓ 68.6K/mes21 oct 2026
MIT21 oct 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
tavily-ai/tavily-python
The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
Python★ 1375↓ 8.5M/mes27 ago 2026
MIT27 ago 2026 · métricas 2.10.0
npm · Packagist · crates.io +1
78Buenoíndice de salud
xberg-io/crawlberg
High-performance web crawling engine with bindings for 11 languages
Rust★ 173↓ 1094/mes15 sept 2026
MIT15 sept 2026 · métricas 2.10.0
npm
73Buenoíndice de salud
Kikobeats/xml-urls
Extract all URLs from Feed, Atom, RSS, and Sitemap XML markup for crawling and auditing.
JavaScript★ 12↓ 1005/mes10 sept 2026
MIT10 sept 2026 · métricas 2.10.0
npm · PyPI
71Buenoíndice de salud
dondai1234/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 867↓ 536/mes10 sept 2026
MIT10 sept 2026 · métricas 2.10.0
npm
69Buenoíndice de salud
mysleekdesigns/crawlforge-mcp
31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5464/mes21 oct 2026
MIT21 oct 2026 · métricas 2.10.0
npm
67Buenoíndice de salud
superagents-lab/search1api-mcp
Official Search1API MCP server for web search, news, crawling, sitemaps, and trends—hosted with OAuth 2.1 or local via npm.
TypeScript · JavaScript★ 173↓ 2722/mes24 ago 2026
MIT24 ago 2026 · métricas 2.10.0
npm
62Moderadoíndice de salud
Kikobeats/html-urls
Extract all href and src URLs from HTML markup for crawling, auditing, and link checks.
JavaScript★ 12↓ 5973/mes15 sept 2026
MIT15 sept 2026 · métricas 2.10.0
npm
62Moderadoíndice de salud
tavily-ai/tavily-mcp
Production ready MCP server with real-time search, extract, map & crawl.
TypeScript★ 2382↓ 86.8K/mes15 sept 2026
MIT15 sept 2026 · métricas 2.10.0
npm
60Moderadoíndice de salud
tavily-ai/ai-sdk
AI SDK tools for Tavily, built for Vercel's AI SDK v5.
TypeScript★ 5↓ 58K/mes21 oct 2026
MIT21 oct 2026 · métricas 2.10.0
npm
59Moderadoíndice de salud
olostep-api/olostep-js
nodejs SDK of the Olostep API
TypeScript★ 6↓ 10.3K/mes15 sept 2026
Sin licencia15 sept 2026 · métricas 2.10.0
npm
57Moderadoíndice de salud
brandonkramer/pi-scraper
Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.
TypeScript · HTML★ 7↓ 367/mes20 oct 2026
MIT20 oct 2026 · métricas 2.10.0
Go
56Moderadoíndice de salud
0xMassi/webclaw-go
Official Go SDK for the Webclaw web extraction API
Go★ 113 sept 2026
MIT13 sept 2026 · métricas 2.10.0
Packagist
47Débilíndice de salud
terminal42/escargot
A web crawler or spider library based on Symfony components
PHP★ 59↓ 51K/mes12 oct 2026
Sin licencia12 oct 2026 · métricas 2.10.0
PyPI
31En riesgoíndice de salud
ReaJason/xhs
基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/
Python★ 221912 oct 2026
MIT12 oct 2026 · métricas 2.10.0
npm
29En riesgoíndice de salud
ddoojoang/ttj-skills-playwright
El repositorio no publica descripción.
TypeScript · JavaScript★ 1↓ 301/mes14 sept 2026
Sin licencia14 sept 2026 · métricas 2.10.0