Todas las etiquetas
Etiqueta del catálogo

#crawl

Todos los repositorios del registro público que llevan esta etiqueta, procedente de sus topics de GitHub o de las palabras clave que publican sus registros de paquetes. La salud se mide con la misma metodología versionada que el resto del registro.

11 registros
Con la etiqueta «crawl»Ordenado por índice de salud
npm · PyPI · crates.io
87Excelenteíndice de salud
us/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 518↓ 9070/mes3 ago 2026
AGPL-3.03 ago 2026 · métricas 2.10.0
PyPI
78Buenoíndice de salud
tavily-ai/tavily-python
The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
Python★ 1375↓ 8.5M/mes27 ago 2026
MIT27 ago 2026 · métricas 2.10.0
PyPI
75Buenoíndice de salud
ScrapingBee/scrapingbee-cli
El repositorio no publica descripción.
Python★ 1072 ago 2026
MIT2 ago 2026 · métricas 2.10.0
npm
67Buenoíndice de salud
superagents-lab/search1api-mcp
Official Search1API MCP server for web search, news, crawling, sitemaps, and trends—hosted with OAuth 2.1 or local via npm.
TypeScript · JavaScript★ 173↓ 2722/mes24 ago 2026
MIT24 ago 2026 · métricas 2.10.0
npm
63Moderadoíndice de salud
mysleekdesigns/crawlforge-mcp
28 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5179/mes5 sept 2026
MIT5 sept 2026 · métricas 2.10.0
npm
63Moderadoíndice de salud
tavily-ai/tavily-n8n-node
A node for n8n that integrates the Tavily API, enabling powerful web search and content extraction within your no-code automation workflows.
TypeScript★ 20↓ 82.8K/mes4 sept 2026
MIT4 sept 2026 · métricas 2.10.0
npm
60Moderadoíndice de salud
tavily-ai/ai-sdk
AI SDK tools for Tavily, built for Vercel's AI SDK v5.
TypeScript★ 5↓ 69.5K/mes4 sept 2026
MIT4 sept 2026 · métricas 2.10.0
npm
59Moderadoíndice de salud
brandonkramer/pi-scraper
Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.
TypeScript · HTML★ 7↓ 607/mes28 ago 2026
MIT28 ago 2026 · métricas 2.10.0
Go
51Moderadoíndice de salud
0xMassi/webclaw-go
Official Go SDK for the Webclaw web extraction API
Go★ 124 jul 2026
MIT24 jul 2026 · métricas 2.10.0
npm
31En riesgoíndice de salud
ddoojoang/ttj-skills-playwright
El repositorio no publica descripción.
TypeScript · JavaScript★ 1↓ 3696/mes29 jul 2026
Sin licencia29 jul 2026 · métricas 2.10.0