PyPI
ArchiveBox/abx-plugins
🧩 Plugins and extractors that ArchiveBox + abx-dl use: chrome, ytdlp, wget, singlefile, readability, forum-dl, gallery-dl, papers-dl, and more...
MIT27. Juli 2026 · Metriken 2.10.0
Alle Tags
Katalog-Tag
#web-scraping
Alle Repositories im öffentlichen Register, die dieses Tag tragen — aus ihren GitHub-Topics oder den von ihren Paket-Registries veröffentlichten Schlagwörtern. Die Gesundheit wird nach derselben versionierten Methodik gemessen wie im übrigen Register.
107 Einträge
npm
anchorbrowser/AnchorBrowser-SDK-Typescript
AnchorBrowser-SDK-Typescript
Apache-2.08. Aug. 2026 · Metriken 2.10.0
PyPI · crates.io · npm
bug-ops/scrape-rs
🦀 High-performance HTML parsing library. Rust core with native bindings for Python, Node.js & WASM. SIMD-accelerated, memory-safe, consistent API everywhere.
Apache-2.05. Sept. 2026 · Metriken 2.10.0
npm · crates.io
olo-dot-io/uni-cli
Operations substrate for AI agents that use real software: 311 sites/tools, logged-in browsers, desktop apps, local tools, MCP, policy, evidence, AgentEnvelope v2, and self-repair.
Apache-2.017. Juli 2026 · Metriken 2.10.0
PyPI · npm
CloakHQ/CloakBrowser
Stealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.
MIT5. Aug. 2026 · Metriken 2.10.0
Go
HappyHackingSpace/dit
HTML page, form and field type classifier using ML (LogReg + CRF)
MIT22. Juli 2026 · Metriken 2.10.0
npm
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
MIT28. Aug. 2026 · Metriken 2.10.0
Go
karust/openserp
Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉
MIT14. Aug. 2026 · Metriken 2.10.0
Go · npm
klarlabs-studio/scout
Browser automation, one binary. The simpler alternative to Playwright — no Node, no Python, no runtime. Library, CLI, MCP server, and chat UI for any AI agent.
MIT5. Sept. 2026 · Metriken 2.10.0
npm
microlinkhq/browserless
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
MIT18. Juli 2026 · Metriken 2.10.0
Go · PyPI
zoharbabin/web-researcher-mcp
The AI research assistant that cites real sources honestly — and searches the web. Your AI research assistant that cites real sources and stays honest. Works with Claude, Cursor, any MCP client.
MIT20. Juli 2026 · Metriken 2.10.0
crates.io
0x676e67/wreq-util
Common utilities for wreq
Apache-2.05. Sept. 2026 · Metriken 2.10.0
npm
MrAdex77/google-play-scraper
Google Play scraper for Node.js with a fully typed TypeScript API. App details, search, top charts, reviews, permissions and data safety. A modern replacement for the unmaintained google-play-scraper.
MIT23. Juli 2026 · Metriken 2.10.0
PyPI
adbar/htmldate
Fast and robust date extraction from web pages, with Python or on the command-line
Apache-2.027. Aug. 2026 · Metriken 2.10.0
Go
kinorai/omnifeed
LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
MIT3. Sept. 2026 · Metriken 2.10.0
PyPI
rushter/selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
MIT20. Juli 2026 · Metriken 2.10.0
npm
vmoranv/jshookmcp
js hook toolkit that all you need
AGPL-3.018. Juli 2026 · Metriken 2.10.0
npm · crates.io · Packagist +1
xberg-io/crawlberg
High-performance web crawling engine with bindings for 11 languages
MIT1. Aug. 2026 · Metriken 2.10.0
npm
n1byn1kt/apitap
CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.
Apache-2.05. Aug. 2026 · Metriken 2.10.0
npm · crates.io
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
AGPL-3.026. Juli 2026 · Metriken 2.10.0
npm
firecrawl/cli
CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents
Keine Lizenz26. Juli 2026 · Metriken 2.10.0
npm
F4RAN/cuimp-ts
A Node.js wrapper for curl-impersonate that allows you to make HTTP requests that mimic real browser behavior, bypassing many anti-bot protections.
Keine Lizenz1. Aug. 2026 · Metriken 2.10.0
npm
alexandriashai/cbrowser
Cognitive Browser: The browser automation that thinks. Constitutional safety • Persona UX testing • Natural language interface • Self-healing selectors • Built for AI agents
Eigene Lizenz17. Juli 2026 · Metriken 2.10.0
npm
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
Eigene Lizenz5. Sept. 2026 · Metriken 2.10.0
npm
scrape-badger/scrapebadger-node
Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more
MIT5. Sept. 2026 · Metriken 2.10.0
Go · npm
1broseidon/ketch
Fast, stateless CLI for web search and scrape. Built for AI agents.
MIT18. Juli 2026 · Metriken 2.10.0
Go
ChristopherDavenport/unblink
Pure-Go browser for AI: fetch pages, optionally render JS (no Chromium), get clean token-budgeted Markdown over MCP
MIT22. Juli 2026 · Metriken 2.10.0
PyPI
ebarti/jobstreaming
Concurrent, resumable job collection for Python with typed events, durable checkpoints, normalized models, and a DataFrame API.
MIT29. Aug. 2026 · Metriken 2.10.0
Go
gosom/scrapemate
Golang Crawling and scraping framework
MIT2. Aug. 2026 · Metriken 2.10.0
Go · npm
sardanioss/httpcloak
Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.
MIT15. Juli 2026 · Metriken 2.10.0