All tags
Catalogue tag

#scraper

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

120 records
Tagged “scraper”Ranked by health index
npm
99Exceptionalhealth index
apify/crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript · MDX★ 26.2K↓ 6.8M/moOct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
PyPI · npm
99Exceptionalhealth index
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python · MDX★ 9,535↓ 975.8K/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
PyPI · npm
97Exceptionalhealth index
apify/apify-sdk-python
Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Python · MDX★ 176↓ 232.6K/moSep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
npm
96Exceptionalhealth index
cheeriojs/cheerio
The fast, flexible, and elegant library for parsing and manipulating HTML and XML.
TypeScript · HTML · Astro★ 30.5K↓ 105M/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI
94Exceptionalhealth index
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ
Python★ 81.4KSep 16, 2026
BSD-3-ClauseSep 16, 2026 · metrics 2.10.0
npm
94Exceptionalhealth index
apify/apify-client-js
Apify API client for JavaScript / Node.js.
TypeScript★ 90↓ 1.4M/moSep 20, 2026
Apache-2.0Sep 20, 2026 · metrics 2.10.0
PyPI · Packagist · crates.io +2
94Exceptionalhealth index
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
TypeScript · Python★ 181.1K↓ 5.8M/moSep 16, 2026
AGPL-3.0Sep 16, 2026 · metrics 2.10.0
npm
92Excellenthealth index
apify/apify-sdk-js
Apify SDK monorepo
MDX · TypeScript★ 186↓ 178.2K/moSep 12, 2026
Apache-2.0Sep 12, 2026 · metrics 2.10.0
PyPI
92Excellenthealth index
mikf/gallery-dl
Command-line program to download image galleries and collections from several image hosting sites
Python★ 19.7K↓ 320.4K/moSep 16, 2026
GPL-2.0Sep 16, 2026 · metrics 2.10.0
PyPI
91Excellenthealth index
adbar/trafilatura
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/moAug 28, 2026
Apache-2.0Aug 28, 2026 · metrics 2.10.0
crates.io · npm · PyPI
91Excellenthealth index
fastcrw/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,095↓ 10.6K/moOct 2, 2026
AGPL-3.0Oct 2, 2026 · metrics 2.10.0
PyPI · npm
91Excellenthealth index
henrique-coder/perplexity-webui-scraper
An advanced, high-performance Python client, MCP server, and REST API for reverse-engineering Perplexity AI's WebUI.
Python★ 137↓ 11.5K/moOct 19, 2026
MITOct 19, 2026 · metrics 2.10.0
crates.io · npm · PyPI
91Excellenthealth index
us/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,032↓ 10.7K/moSep 16, 2026
AGPL-3.0Sep 16, 2026 · metrics 2.10.0
PyPI · npm
90Excellenthealth index
apify/fingerprint-suite
Browser fingerprinting tools for anonymizing your scrapers. Developed by Apify.
TypeScript · JavaScript★ 2,599↓ 2M/moSep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
crates.io
89Excellenthealth index
0x676e67/wreq
An ergonomic, privacy-aware Rust HTTP Client
Rust★ 1,076↓ 222.8K/moOct 20, 2026
Apache-2.0Oct 20, 2026 · metrics 2.10.0
npm
89Excellenthealth index
Xquik-dev/tweetclaw
OpenClaw plugin for Twitter search, follower exports, monitoring & approved X actions. Not affiliated with X Corp.
TypeScript · JavaScript★ 91↓ 1,114/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
Maven
88Excellenthealth index
TeamNewPipe/NewPipeExtractor
NewPipe's core library for extracting data from streaming sites
Java★ 1,972Sep 17, 2026
GPL-3.0Sep 17, 2026 · metrics 2.10.0
PyPI
88Excellenthealth index
alexdlaird/amazon-orders
A Python library (and CLI) for Amazon order history, line items, and transactions
Python★ 182↓ 12.1K/moOct 3, 2026
MITOct 3, 2026 · metrics 2.10.0
npm
88Excellenthealth index
microlinkhq/metascraper
Scrape metadata from any URL using Open Graph, JSON-LD, HTML meta tags, and smart fallbacks.
HTML★ 2,747↓ 1.6M/moOct 18, 2026
MITOct 18, 2026 · metrics 2.10.0
PyPI · crates.io
87Excellenthealth index
0x676e67/wreq-python
An ergonomic, privacy-aware Python HTTP Client
Rust · Python★ 1,441Sep 17, 2026
Apache-2.0Sep 17, 2026 · metrics 2.10.0
npm
87Excellenthealth index
getmaxun/maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
TypeScript★ 17.5KSep 16, 2026
AGPL-3.0Sep 16, 2026 · metrics 2.10.0
PyPI
86Excellenthealth index
ZenRows/zenrows-python-sdk
SDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/moOct 16, 2026
MITOct 16, 2026 · metrics 2.10.0
npm · RubyGems
86Excellenthealth index
huginn/huginn
Create agents that monitor and act on your behalf. Your agents are standing by!
Ruby★ 50KSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
crates.io
84Excellenthealth index
spider-rs/spider
Foundational low latency web data collecting in Rust
Rust★ 2,790↓ 24.2K/moOct 20, 2026
MITOct 20, 2026 · metrics 2.10.0
PyPI
83Excellenthealth index
jordantete/OddsHarvester
A python app designed to scrape and process sports betting data directly from oddsportal.com 🎯
Python · HTML★ 243Sep 12, 2026
MITSep 12, 2026 · metrics 2.10.0
PyPI
81Excellenthealth index
bdperkin/gamesheet-sdk-py
Unofficial Python SDK and CLI for the GameSheet Inc. platform — automates WebUI procedures where a native API is absent.
Python★ 1↓ 2,468/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
RubyGems
81Excellenthealth index
html2rss/html2rss
📰 Build RSS 2.0 feeds from websites (and JSON APIs) automatically or with a few CSS selectors.
Ruby★ 163Sep 17, 2026
MITSep 17, 2026 · metrics 2.10.0
PyPI
81Excellenthealth index
vladkens/twscrape
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
Python★ 2,782↓ 81.7K/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
openzim/zimit
Make a ZIM file from any Web site and surf offline!
Python★ 844Sep 20, 2026
GPL-3.0Sep 20, 2026 · metrics 2.10.0