web-crawler — Gesundheit von Open-Source-Software

npm

84GutGesundheitsindex

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

TypeScript · MDX★ 24.8K19. Juli 2026

Apache-2.019. Juli 2026 · Metriken 1.13.0

—

81GutGesundheitsindex

mendableai/firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

TypeScript · Python★ 151.8K16. Juli 2026

AGPL-3.016. Juli 2026 · Metriken 1.13.0

—

80GutGesundheitsindex

firecrawl/firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

TypeScript★ 149.9K↓ 0/Monat13. Juli 2026

AGPL-3.013. Juli 2026 · Metriken 1.13.0

npm

73GutGesundheitsindex

KnockOutEZ/wigolo

The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.

TypeScript★ 3.201↓ 3.522/Monat22. Juli 2026

Eigene Lizenz22. Juli 2026 · Metriken 1.13.0

crates.io

71GutGesundheitsindex

spider-rs/spider

Get web data for AI agents and LLMs

Rust★ 2.601↓ 52.8K/Monat14. Juli 2026

MIT14. Juli 2026 · Metriken 1.13.0

npm

68MittelGesundheitsindex

microlinkhq/browserless

The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.

JavaScript★ 1.82618. Juli 2026

MIT18. Juli 2026 · Metriken 1.13.0

crates.io · npm · Packagist +1

64MittelGesundheitsindex

xberg-io/crawlberg

High-performance web crawling engine with bindings for 11 languages

Rust★ 140↓ 0/Monat14. Juli 2026

MIT14. Juli 2026 · Metriken 1.13.0

npm · crates.io · Go +1

58MittelGesundheitsindex

spider-rs/spider-clients

Python, Javascript, and Rust libraries for the Spider Cloud API.

Rust · Python · Go★ 26↓ 16.3K/Monat16. Juli 2026

MIT16. Juli 2026 · Metriken 1.13.0

npm

57MittelGesundheitsindex

mysleekdesigns/crawlforge-mcp

26-tool MCP server for web scraping, crawling, deep research & autonomous extraction — clean Markdown & structured JSON for Claude, Cursor & any MCP client. 1,000 free credits, local-Ollama LLM support.

JavaScript★ 1↓ 2.975/Monat14. Juli 2026

MIT14. Juli 2026 · Metriken 1.13.0

Maven

25KritischGesundheitsindex

ssssssss-team/spider-flow

新一代爬虫平台，以图形化方式定义爬虫流程，不写代码即可完成爬虫。

Java★ 11.3K21. Juli 2026

MIT21. Juli 2026 · Metriken 1.13.0

#web-crawler