npm99Exceptionalhealth index
apify/crawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript · MDX★ 26.2K↓ 6.8M/moOct 19, 2026
PyPI · npm99Exceptionalhealth index
apify/crawlee-pythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python · MDX★ 9,535↓ 975.8K/moSep 17, 2026
PyPI · npm97Exceptionalhealth index
apify/apify-client-pythonApify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.
Python★ 97↓ 2.8M/moAug 27, 2026
PyPI · npm97Exceptionalhealth index
apify/apify-sdk-pythonApify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Python · MDX★ 176↓ 232.6K/moSep 11, 2026
Packagist · PyPI95Exceptionalhealth index
PHP★ 3,296↓ 147.9K/moSep 12, 2026
PyPI94Exceptionalhealth index
D4Vinci/Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ
Python★ 81.4KSep 16, 2026
PyPI94Exceptionalhealth index
Python★ 31KSep 16, 2026
npm · PyPI · Go94Exceptionalhealth index
TypeScript · MDX★ 24.3K↓ 6.4M/moSep 16, 2026
PyPI · Packagist · crates.io +294Exceptionalhealth index
TypeScript · Python★ 181.1K↓ 5.8M/moSep 16, 2026
PyPI94Exceptionalhealth index
lexiforest/curl_cffiPython binding for curl-impersonate fork via cffi. A http client that can impersonate browser tls/ja3/http2 fingerprints.
Python★ 6,515Sep 20, 2026
npm · Go92Excellenthealth index
pinchtab/pinchtabHigh-performance browser automation bridge and multi-instance orchestrator with advanced stealth injection and real-time dashboard.
Go · Shell★ 10.1K↓ 7,120/moAug 28, 2026
PyPI91Excellenthealth index
adbar/trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/moAug 28, 2026
crates.io · npm · PyPI91Excellenthealth index
fastcrw/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,095↓ 10.6K/moOct 2, 2026
PyPI91Excellenthealth index
Python★ 13K↓ 3M/moAug 27, 2026
crates.io · npm · PyPI91Excellenthealth index
us/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,032↓ 10.7K/moSep 16, 2026
PyPI90Excellenthealth index
feder-cr/invisible_playwrightPlaywright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
Python★ 2,499↓ 32.3K/moOct 21, 2026
PyPI · npm90Excellenthealth index
Python★ 480↓ 5,294/moSep 11, 2026
Maven90Excellenthealth index
jhy/jsoupjsoup: the Java HTML parser, built for HTML editing, cleaning, scraping, and XSS safety.
Java · HTML★ 11.4KAug 27, 2026
PyPI90Excellenthealth index
tox-dev/turbohtmlA fast, fully typed HTML toolkit for Python. Escape, unescape, parse, select, and serialize HTML from one library, powered by a C-accelerated core.
C · Python★ 20↓ 30.3K/moOct 1, 2026
PyPI · npm90Excellenthealth index
yusufkaraaslan/Skill_SeekersConvert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Python★ 15K↓ 22.1K/moSep 19, 2026
Go · PyPI90Excellenthealth index
zoharbabin/web-researcher-mcpGive your AI assistant real web search, full-page reading, and multi-source research with citations that are never fabricated.
Go★ 57Sep 11, 2026
npm89Excellenthealth index
TypeScript · JavaScript★ 7,332↓ 492.7K/moAug 28, 2026
npm89Excellenthealth index
microlinkhq/browserlessThe headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
JavaScript★ 1,834↓ 71.9K/moSep 11, 2026
npm · crates.io89Excellenthealth index
sqdshguy/wreq-jsHTTP client for Node.js with browser TLS fingerprint impersonation
TypeScript · Rust★ 402↓ 498.7K/moSep 23, 2026
npm · PyPI88Excellenthealth index
MODSetter/SurfSenseOpen-source NotebookLM alternative. Research the open web with live data(Reddit, YT, IG, TikTok, Indeed, Google Search, Maps etc) through one platform, API or MCP server. Join our Discord: https://discord.gg/ejRNvftDp9
Python · TypeScript★ 16.2KSep 16, 2026
PyPI88Excellenthealth index
Python★ 182↓ 12.1K/moOct 3, 2026
PyPI · crates.io87Excellenthealth index
Rust · Python★ 1,441Sep 17, 2026
npm · crates.io87Excellenthealth index
0xMassi/webclawFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Rust★ 2,343↓ 1,301/moSep 13, 2026
npm87Excellenthealth index
getmaxun/maxun🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
TypeScript★ 17.5KSep 16, 2026
npm87Excellenthealth index
jo-inc/camofox-browserStealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
JavaScript★ 8,924↓ 243.1K/moAug 28, 2026
