PyPI
ArchiveBox/abx-plugins
🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...
MITJul 27, 2026 · metrics 2.10.0
All tags
Catalogue tag
#web-scraping
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
107 records
npm
anchorbrowser/AnchorBrowser-SDK-Typescript
AnchorBrowser-SDK-Typescript
Apache-2.0Aug 8, 2026 · metrics 2.10.0
PyPI · crates.io · npm
bug-ops/scrape-rs
🦀 High-performance HTML parsing library. Rust core with native bindings for Python, Node.js & WASM. SIMD-accelerated, memory-safe, consistent API everywhere.
Apache-2.0Sep 5, 2026 · metrics 2.10.0
npm · crates.io
olo-dot-io/uni-cli
Operations substrate for AI agents that use real software: 311 sites/tools, logged-in browsers, desktop apps, local tools, MCP, policy, evidence, AgentEnvelope v2, and self-repair.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
PyPI · npm
CloakHQ/CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.
MITAug 5, 2026 · metrics 2.10.0
Go
HappyHackingSpace/dit
HTML page, form and field type classifier using ML (LogReg + CRF)
MITJul 22, 2026 · metrics 2.10.0
npm
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
MITAug 28, 2026 · metrics 2.10.0
Go
karust/openserp
Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉
MITAug 14, 2026 · metrics 2.10.0
Go · npm
klarlabs-studio/scout
Browser automation, one binary. The simpler alternative to Playwright — no Node, no Python, no runtime. Library, CLI, MCP server, and chat UI for any AI agent.
MITSep 5, 2026 · metrics 2.10.0
npm
microlinkhq/browserless
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
MITJul 18, 2026 · metrics 2.10.0
Go · PyPI
zoharbabin/web-researcher-mcp
The AI research assistant that cites real sources honestly — and searches the web. Your AI research assistant that cites real sources and stays honest. Works with Claude, Cursor, any MCP client.
MITJul 20, 2026 · metrics 2.10.0
crates.io
0x676e67/wreq-util
Common utilities for wreq
Apache-2.0Sep 5, 2026 · metrics 2.10.0
npm
MrAdex77/google-play-scraper
Google Play scraper for Node.js with a fully typed TypeScript API. App details, search, top charts, reviews, permissions and data safety. A modern replacement for the unmaintained google-play-scraper.
MITJul 23, 2026 · metrics 2.10.0
PyPI
adbar/htmldate
Fast and robust date extraction from web pages, with Python or on the command-line
Apache-2.0Aug 27, 2026 · metrics 2.10.0
Go
kinorai/omnifeed
LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
MITSep 3, 2026 · metrics 2.10.0
PyPI
rushter/selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
MITJul 20, 2026 · metrics 2.10.0
npm
vmoranv/jshookmcp
js hook toolkit that all you need
AGPL-3.0Jul 18, 2026 · metrics 2.10.0
npm · crates.io · Packagist +1
xberg-io/crawlberg
High-performance web crawling engine with bindings for 11 languages
MITAug 1, 2026 · metrics 2.10.0
npm
n1byn1kt/apitap
CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.
Apache-2.0Aug 5, 2026 · metrics 2.10.0
npm · crates.io
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
AGPL-3.0Jul 26, 2026 · metrics 2.10.0
npm
firecrawl/cli
CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents
No licenseJul 26, 2026 · metrics 2.10.0
npm
F4RAN/cuimp-ts
A Node.js wrapper for curl-impersonate that allows you to make HTTP requests that mimic real browser behavior, bypassing many anti-bot protections.
No licenseAug 1, 2026 · metrics 2.10.0
npm
alexandriashai/cbrowser
Cognitive Browser: The browser automation that thinks. Constitutional safety • Persona UX testing • Natural language interface • Self-healing selectors • Built for AI agents
Custom licenseJul 17, 2026 · metrics 2.10.0
npm
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
Custom licenseSep 5, 2026 · metrics 2.10.0
npm
scrape-badger/scrapebadger-node
Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more
MITSep 5, 2026 · metrics 2.10.0
Go · npm
1broseidon/ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
MITJul 18, 2026 · metrics 2.10.0
Go
ChristopherDavenport/unblink
Pure-Go browser for AI: fetch pages, optionally render JS (no Chromium), get clean token-budgeted Markdown over MCP
MITJul 22, 2026 · metrics 2.10.0
PyPI
ebarti/jobstreaming
Concurrent, resumable job collection for Python with typed events, durable checkpoints, normalized models, and a DataFrame API.
MITAug 29, 2026 · metrics 2.10.0
Go
gosom/scrapemate
Golang Crawling and scraping framework
MITAug 2, 2026 · metrics 2.10.0
Go · npm
sardanioss/httpcloak
Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.
MITJul 15, 2026 · metrics 2.10.0