Alle Tags
Katalog-Tag

#crawl

Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.

22 Einträge
Getaggt als „crawl“Geordnet nach Gesundheitsindex
crates.io · npm · PyPI
91ExzellentGesundheitsindex
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1.095↓ 10.6K/Monat2. Okt. 2026
AGPL-3.02. Okt. 2026 · Metriken 2.10.0
crates.io · npm · PyPI
91ExzellentGesundheitsindex
us/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1.032↓ 10.7K/Monat16. Sept. 2026
AGPL-3.016. Sept. 2026 · Metriken 2.10.0
PyPI
86ExzellentGesundheitsindex
ZenRows/zenrows-python-sdk
SDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/Monat16. Okt. 2026
MIT16. Okt. 2026 · Metriken 2.10.0
PyPI
81ExzellentGesundheitsindex
ScrapingBee/scrapingbee-cli
Keine Repository-Beschreibung veröffentlicht.
Python★ 107↓ 350/Monat15. Sept. 2026
MIT15. Sept. 2026 · Metriken 2.10.0
Packagist
81ExzellentGesundheitsindex
chrome-php/chrome
Instrument headless chrome/chromium instances from PHP
PHP★ 2.677↓ 314.5K/Monat8. Sept. 2026
MIT8. Sept. 2026 · Metriken 2.10.0
npm
80ExzellentGesundheitsindex
tavily-ai/tavily-n8n-node
A node for n8n that integrates the Tavily API, enabling powerful web search and content extraction within your no-code automation workflows.
TypeScript★ 21↓ 68.6K/Monat21. Okt. 2026
MIT21. Okt. 2026 · Metriken 2.10.0
PyPI
78GutGesundheitsindex
tavily-ai/tavily-python
The Tavily Python SDK allows for easy interaction with the Tavily API, offering the full range of our search, extract, crawl, map, and research functionalities directly from your Python programs. Easily integrate smart search, content extraction, and research capabilities into your applications, harnessing Tavily's powerful features.
Python★ 1.375↓ 8.5M/Monat27. Aug. 2026
MIT27. Aug. 2026 · Metriken 2.10.0
npm · Packagist · crates.io +1
78GutGesundheitsindex
xberg-io/crawlberg
High-performance web crawling engine with bindings for 11 languages
Rust★ 173↓ 1.094/Monat15. Sept. 2026
MIT15. Sept. 2026 · Metriken 2.10.0
npm
73GutGesundheitsindex
Kikobeats/xml-urls
Extract all URLs from Feed, Atom, RSS, and Sitemap XML markup for crawling and auditing.
JavaScript★ 12↓ 1.005/Monat10. Sept. 2026
MIT10. Sept. 2026 · Metriken 2.10.0
npm · PyPI
71GutGesundheitsindex
dondai1234/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 867↓ 536/Monat10. Sept. 2026
MIT10. Sept. 2026 · Metriken 2.10.0
npm
69GutGesundheitsindex
mysleekdesigns/crawlforge-mcp
31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5.464/Monat21. Okt. 2026
MIT21. Okt. 2026 · Metriken 2.10.0
npm
67GutGesundheitsindex
superagents-lab/search1api-mcp
Official Search1API MCP server for web search, news, crawling, sitemaps, and trends—hosted with OAuth 2.1 or local via npm.
TypeScript · JavaScript★ 173↓ 2.722/Monat24. Aug. 2026
MIT24. Aug. 2026 · Metriken 2.10.0
npm
62MittelGesundheitsindex
Kikobeats/html-urls
Extract all href and src URLs from HTML markup for crawling, auditing, and link checks.
JavaScript★ 12↓ 5.973/Monat15. Sept. 2026
MIT15. Sept. 2026 · Metriken 2.10.0
npm
62MittelGesundheitsindex
tavily-ai/tavily-mcp
Production ready MCP server with real-time search, extract, map & crawl.
TypeScript★ 2.382↓ 86.8K/Monat15. Sept. 2026
MIT15. Sept. 2026 · Metriken 2.10.0
npm
60MittelGesundheitsindex
tavily-ai/ai-sdk
AI SDK tools for Tavily, built for Vercel's AI SDK v5.
TypeScript★ 5↓ 58K/Monat21. Okt. 2026
MIT21. Okt. 2026 · Metriken 2.10.0
npm
59MittelGesundheitsindex
olostep-api/olostep-js
nodejs SDK of the Olostep API
TypeScript★ 6↓ 10.3K/Monat15. Sept. 2026
Keine Lizenz15. Sept. 2026 · Metriken 2.10.0
npm
57MittelGesundheitsindex
brandonkramer/pi-scraper
Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.
TypeScript · HTML★ 7↓ 367/Monat20. Okt. 2026
MIT20. Okt. 2026 · Metriken 2.10.0
Go
56MittelGesundheitsindex
0xMassi/webclaw-go
Official Go SDK for the Webclaw web extraction API
Go★ 113. Sept. 2026
MIT13. Sept. 2026 · Metriken 2.10.0
Packagist
47SchwachGesundheitsindex
terminal42/escargot
A web crawler or spider library based on Symfony components
PHP★ 59↓ 51K/Monat12. Okt. 2026
Keine Lizenz12. Okt. 2026 · Metriken 2.10.0
PyPI
31GefährdetGesundheitsindex
ReaJason/xhs
基于小红书 Web 端进行的请求封装。https://reajason.github.io/xhs/
Python★ 2.21912. Okt. 2026
MIT12. Okt. 2026 · Metriken 2.10.0
npm
29GefährdetGesundheitsindex
ddoojoang/ttj-skills-playwright
Keine Repository-Beschreibung veröffentlicht.
TypeScript · JavaScript★ 1↓ 301/Monat14. Sept. 2026
Keine Lizenz14. Sept. 2026 · Metriken 2.10.0