crates.io · npm · PyPI91Excellenthealth index
fastcrw/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,095↓ 10.6K/moOct 2, 2026
crates.io · npm · PyPI91Excellenthealth index
us/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,032↓ 10.7K/moSep 16, 2026
PyPI86Excellenthealth index
ZenRows/zenrows-python-sdkSDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/moOct 16, 2026
PyPI81Excellenthealth index
Python★ 107↓ 350/moSep 15, 2026
Packagist81Excellenthealth index
PHP★ 2,677↓ 314.5K/moSep 8, 2026
npm80Excellenthealth index
tavily-ai/tavily-n8n-nodeA node for n8n that integrates the Tavily API, enabling powerful web search and content extraction within your no-code automation workflows.
TypeScript★ 21↓ 68.6K/moOct 21, 2026
tavily-ai/tavily-pythonThe Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
Python★ 1,375↓ 8.5M/moAug 27, 2026
npm · Packagist · crates.io +178Goodhealth index
Rust★ 173↓ 1,094/moSep 15, 2026
C#★ 0Oct 21, 2026
Kikobeats/xml-urlsExtract all URLs from Feed, Atom, RSS, and Sitemap XML markup for crawling and auditing.
JavaScript★ 12↓ 1,005/moSep 10, 2026
npm · PyPI71Goodhealth index
dondai1234/master-fetchMCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 867↓ 536/moSep 10, 2026
mysleekdesigns/crawlforge-mcp31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5,464/moOct 21, 2026
superagents-lab/search1api-mcpOfficial Search1API MCP server for web search, news, crawling, sitemaps, and trends—hosted with OAuth 2.1 or local via npm.
TypeScript · JavaScript★ 173↓ 2,722/moAug 24, 2026
npm62Moderatehealth index
Kikobeats/html-urlsExtract all href and src URLs from HTML markup for crawling, auditing, and link checks.
JavaScript★ 12↓ 5,973/moSep 15, 2026
npm62Moderatehealth index
TypeScript★ 2,382↓ 86.8K/moSep 15, 2026
npm60Moderatehealth index
TypeScript★ 5↓ 58K/moOct 21, 2026
npm59Moderatehealth index
TypeScript★ 6↓ 10.3K/moSep 15, 2026
npm57Moderatehealth index
brandonkramer/pi-scraperPi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.
TypeScript · HTML★ 7↓ 367/moOct 20, 2026
Go★ 1Sep 13, 2026
Packagist47Weakhealth index
PHP★ 59↓ 51K/moOct 12, 2026
ReaJason/xhs基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/
Python★ 2,219Oct 12, 2026
TypeScript · JavaScript★ 1↓ 301/moSep 14, 2026