All tags
Catalogue tag

#scraping

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

120 records
Tagged “scraping”Ranked by health index
npm
99Exceptionalhealth index
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript · MDX★ 26.2K↓ 6.8M/moOct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI · npm
99Exceptionalhealth index
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python · MDX★ 9,535↓ 975.8K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI · npm
97Exceptionalhealth index
apify/apify-client-python
Apify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.
Python★ 97↓ 2.8M/moAug 27, 2026
Apache-2.0Aug 27, 2026 · metrics 2.10.0
PyPI · npm
97Exceptionalhealth index
apify/apify-sdk-python
Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Python · MDX★ 176↓ 232.6K/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ
Python★ 81.4KSep 16, 2026
BSD-3-ClauseSep 16, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
Python★ 31KSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI · Packagist · crates.io +2
94Exceptionalhealth index
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
TypeScript · Python★ 181.1K↓ 5.8M/moSep 16, 2026
AGPL-3.0Sep 16, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
freelawproject/juriscraper
An API to scrape American court websites for metadata.
HTML★ 647↓ 23K/moOct 19, 2026
BSD-2-ClauseOct 19, 2026 · metrics 2.10.0
crates.io
94Exceptionalhealth index
plabayo/rama
modular service framework to move and transform network packets
Rust★ 1,190↓ 730.4K/moSep 5, 2026
Apache-2.0Sep 5, 2026 · metrics 2.10.0
PyPI
93Exceptionalhealth index
browser-use/browser-harness
Browser Harness | Self-healing harness that enables LLMs to complete any task.
Python · HTML★ 17.6K↓ 6.8M/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI
91Excellenthealth index
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
PyPI
91Excellenthealth index
soxoj/maigret
🕵️‍♂️ Collect a dossier on a person by username from 3000+ sites
Python · HTML★ 37.6K↓ 62.6K/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI · npm
90Excellenthealth index
apify/fingerprint-suite
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
TypeScript · JavaScript★ 2,599↓ 2M/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI
90Excellenthealth index
tox-dev/turbohtml
A fast, fully typed HTML toolkit for Python. Escape, unescape, parse, select, and serialize HTML from one library, powered by a C-accelerated core.
C · Python★ 20↓ 30.3K/moOct 1, 2026
Custom licenseOct 1, 2026 · metrics 2.10.0
PyPI · npm
90Excellenthealth index
yusufkaraaslan/Skill_Seekers
Convert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Python★ 15K↓ 22.1K/moSep 19, 2026
MITSep 19, 2026 · metrics 2.10.0
PyPI
89Excellenthealth index
soxoj/socid-extractor
⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
Python★ 1,089↓ 73.7K/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
npm · crates.io
89Excellenthealth index
sqdshguy/wreq-js
HTTP client for Node.js with browser TLS fingerprint impersonation
TypeScript · Rust★ 402↓ 498.7K/moSep 23, 2026
MITSep 23, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
feder-cr/invisible_playwright
Free antidetect browser stealth for Playwright: undetected headless Firefox fingerprint. Python scraping, recaptcha and bot detection bypass. Open source
Python★ 1,974↓ 15.7K/moSep 4, 2026
MITSep 4, 2026 · metrics 2.10.0
PyPI
87Excellenthealth index
blisspixel/primr
Turn any company URL into a strategic intelligence brief. Adaptive scraping + AI-powered research and synthesis.
Python★ 3↓ 2,172/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
npm · Go
87Excellenthealth index
corsairdev/corsair
Connect your users to their apps
TypeScript★ 11.4K↓ 971/moSep 18, 2026
Custom licenseSep 18, 2026 · metrics 2.10.0
PyPI · npm
87Excellenthealth index
daijro/camoufox
🦊 Anti-detect browser
C++ · Python · JavaScript★ 11.7K↓ 851.4K/moSep 6, 2026
MPL-2.0Sep 6, 2026 · metrics 2.10.0
npm
87Excellenthealth index
getmaxun/maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
TypeScript★ 17.5KSep 16, 2026
AGPL-3.0Sep 16, 2026 · metrics 2.10.0
npm
87Excellenthealth index
jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
JavaScript★ 8,924↓ 243.1K/moAug 28, 2026
MITAug 28, 2026 · metrics 2.10.0
PyPI
86Excellenthealth index
ZenRows/zenrows-python-sdk
SDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/moOct 16, 2026
MITOct 16, 2026 · metrics 2.10.0
npm
86Excellenthealth index
achiya-automation/safari-mcp
Native Safari browser automation for AI agents. 97 tools via AppleScript — zero overhead, keeps logins, runs silently in background. Drop-in alternative to Chrome DevTools MCP with 40-60% less CPU/heat on Apple Silicon.
JavaScript★ 183↓ 7,160/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
npm
84Excellenthealth index
KnockOutEZ/wigolo
The go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
TypeScript★ 5,237↓ 3,896/moSep 12, 2026
Custom licenseSep 12, 2026 · metrics 2.10.0
PyPI
84Excellenthealth index
byteface/domonic
Python DOM and HTML toolkit - generate, parse and manipulate HTML/XML/SVG with CSS selectors, XPath, Web APIs and JavaScript-like utilities.
Python · HTML★ 160↓ 9,088/moSep 15, 2026
MITSep 15, 2026 · metrics 2.10.0
crates.io
84Excellenthealth index
spider-rs/spider
Foundational low latency web data collecting in Rust
Rust★ 2,790↓ 24.2K/moOct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
PyPI · npm
83Excellenthealth index
ArchiveBox/abx-dl
⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...
Python★ 142↓ 267.6K/moSep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
PyPI · npm
83Excellenthealth index
CloakHQ/CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.
Python · C# · TypeScript★ 31.5K↓ 1.1M/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0