All tags
Catalogue tag

#scraping

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

121 records
Tagged “scraping”Ranked by health index
PyPI · crates.io · npm
83Excellenthealth index
bug-ops/scrape-rs
🦀 High-performance HTML parsing library. Rust core with native bindings for Python, Node.js & WASM. SIMD-accelerated, memory-safe, consistent API everywhere.
Rust★ 10↓ 3,671/moOct 21, 2026
Apache-2.0Oct 21, 2026 · metrics 2.10.0
npm
83Excellenthealth index
microlinkhq/top-user-agents
Always up-to-date list of the top 100 most common browser user-agents for HTTP clients.
JavaScript★ 378↓ 18.2K/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
Packagist · npm
83Excellenthealth index
playwright-php/playwright
Playwright PHP library for browser automation: navigation, E2E tests, assertions, screenshots, and so much more!
PHP★ 242↓ 54.2K/moSep 11, 2026
MITSep 11, 2026 · metrics 2.10.0
crates.io
83Excellenthealth index
rust-scraper/scraper
HTML parsing and querying with CSS selectors
Rust★ 2,424↓ 3.3M/moOct 22, 2026
ISCOct 22, 2026 · metrics 2.10.0
PyPI · npm
81Excellenthealth index
ScrapeGraphAI/scrapegraph-py
Official Python SDK for the ScrapeGraph AI API. Smart scraping, search, crawling, markdownify, agentic browser automation, scheduled jobs, and structured data extraction
Jupyter Notebook★ 90↓ 177.8K/moOct 22, 2026
MITOct 22, 2026 · metrics 2.10.0
PyPI
81Excellenthealth index
ScrapingBee/scrapingbee-cli
No repository description published.
Python★ 107↓ 350/moSep 15, 2026
MITSep 15, 2026 · metrics 2.10.0
npm
81Excellenthealth index
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
JavaScript★ 2,651↓ 33.4K/moSep 19, 2026
MITSep 19, 2026 · metrics 2.10.0
PyPI
81Excellenthealth index
n24q02m/web-core
Shared web infrastructure package for search, scraping, HTTP security, and stealth browsers. Used by wet-mcp and downstream applications.
Python★ 3↓ 4,303/moSep 21, 2026
Apache-2.0Sep 21, 2026 · metrics 2.10.0
PyPI
81Excellenthealth index
vladkens/twscrape
Python library and CLI for X/Twitter scraping with multi-account rotation and built-in rate-limit handling.
Python★ 2,782↓ 81.7K/moSep 18, 2026
MITSep 18, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
ArchiveBox/abx-plugins
🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...
Python · JavaScript★ 14↓ 41.2K/moSep 14, 2026
MITSep 14, 2026 · metrics 2.10.0
PyPI
80Excellenthealth index
bruno-portfolio/agrobr
Brazilian agricultural data in one line of code: public sources as clean, validated DataFrames with versioned contracts, provenance and fallback.
Python★ 110↓ 2,513/moOct 10, 2026
MITOct 10, 2026 · metrics 2.10.0
crates.io
80Excellenthealth index
niklak/dom_query
A Flexible Rust Crate for DOM Querying and Manipulation
Rust★ 96↓ 3.6M/moSep 23, 2026
Custom licenseSep 23, 2026 · metrics 2.10.0
Go · npm
78Goodhealth index
1broseidon/ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
Go★ 551Sep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
PyPI
78Goodhealth index
rekursiv-ai/wesearch
A web research toolkit for agents.
Python★ 8↓ 978/moOct 19, 2026
Apache-2.0Oct 19, 2026 · metrics 2.10.0
—
78Goodhealth index
tryAGI/Firecrawl
Generated C# SDK based on official Firecrawl OpenAPI specification
C#★ 4Oct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
Go
77Goodhealth index
Anastylosis/FSS
fss or Full Studio Scraper - scrape all videos metadata of your favourite performers or studios
Go★ 10Oct 20, 2026
GPL-3.0Oct 20, 2026 · metrics 2.10.0
PyPI · npm
77Goodhealth index
kameleo-io/kameleo
Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates with Selenium, Playwright, and Puppeteer via SDKs in Python, JavaScript, and C#.
C# · Python · TypeScript★ 208↓ 167.4K/moOct 7, 2026
No licenseOct 7, 2026 · metrics 2.10.0
Go
75Goodhealth index
ZenRows/zenrows-go-sdk
Zenrows® SDK for effective scraping in the Go programming language
Go★ 3Sep 19, 2026
MITSep 19, 2026 · metrics 2.10.0
PyPI
75Goodhealth index
gawel/pyquery
A jquery-like library for python
Python★ 2,377↓ 1.6M/moSep 16, 2026
Custom licenseSep 16, 2026 · metrics 2.10.0
NuGet · npm
75Goodhealth index
mysticmind/reversemarkdown-net
ReverseMarkdown.Net is a Html to Markdown converter library in C#.
HTML★ 399Sep 14, 2026
MITSep 14, 2026 · metrics 2.10.0
npm
75Goodhealth index
stacksjs/ts-web-scraper
A powerful, type-safe web scraping library for TypeScript.
TypeScript★ 12↓ 169K/moSep 12, 2026
MITSep 12, 2026 · metrics 2.10.0
PyPI
73Goodhealth index
JorG18/agentcrawl
Self-hosted web scraping and Markdown extraction for AI agents
Python★ 10↓ 2,758/moOct 9, 2026
Apache-2.0Oct 9, 2026 · metrics 2.10.0
npm
73Goodhealth index
brightdata/sdk-js
Bright Data's JS SDK, use it to call bright data's scrape and search tools. bypass any Bot-detection or Captcha and extract data from the web.
TypeScript★ 15↓ 37.5K/moSep 15, 2026
MITSep 15, 2026 · metrics 2.10.0
npm · PyPI
71Goodhealth index
dondai1234/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 867↓ 536/moSep 10, 2026
MITSep 10, 2026 · metrics 2.10.0
npm
71Goodhealth index
scrape-badger/scrapebadger-node
Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more
TypeScript★ 2↓ 3,214/moOct 21, 2026
MITOct 21, 2026 · metrics 2.10.0
PyPI
69Goodhealth index
Averyy/wafer
Anti-detection HTTP client for Python that handles TLS fingerprinting, WAF challenge solving, and cookie management.
Python★ 7↓ 149.9K/moSep 14, 2026
Apache-2.0Sep 14, 2026 · metrics 2.10.0
Go · npm
69Goodhealth index
alpkeskin/rota
A high-performance proxy rotation engine with automated IP management and real-time health monitoring
Go · TypeScript★ 748Sep 11, 2026
Apache-2.0Sep 11, 2026 · metrics 2.10.0
Packagist
69Goodhealth index
symfony/panther
A browser testing and web crawling library for PHP and Symfony
PHP★ 3,069↓ 566.6K/moSep 16, 2026
MITSep 16, 2026 · metrics 2.10.0
PyPI · crates.io
67Goodhealth index
awolverp/markupever
The fast, most optimal, and correct HTML & XML parsing library for Python written in Rust.
Rust · Python★ 37↓ 2,604/moOct 3, 2026
MITOct 3, 2026 · metrics 2.10.0