All tags
Catalogue tag

#web-scraping

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

62 records
Tagged “web-scraping”Ranked by health index
Go · npm
62Moderatehealth index
felixgeelhaar/scout
Browser automation, one binary. The simpler alternative to Playwright — no Node, no Python, no runtime. Library, CLI, MCP server, and chat UI for any AI agent.
Go★ 6Jul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
Go · npm
61Moderatehealth index
sardanioss/httpcloak
Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.
Go · C#★ 1,161Jul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
npm
61Moderatehealth index
scrape-badger/scrapebadger-node
Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more
TypeScript★ 2↓ 2,131/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
npm
59Moderatehealth index
apmantza/pi-webaio
AiO webtools for Pi: Search, Fetch, Pull
TypeScript · JavaScript★ 11↓ 1,369/moJul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
Go
59Moderatehealth index
danieljustus/symaira-fetch
AI-native web fetch engine for LLM agents — browser impersonation, semantic DOM pipeline, MCP server. CGO-free Go.
Go★ 1↓ 0/moJul 14, 2026
Custom licenseJul 14, 2026 · metrics 1.13.0
Go
59Moderatehealth index
dotcommander/defuddle
Go library and CLI for extracting web page content — articles, metadata, and clean text from any URL
Go★ 2Jul 17, 2026
MITJul 17, 2026 · metrics 1.13.0
PyPI
58Moderatehealth index
clearcotelabs/clearcote-browser
Open-source stealth Chromium 149 with engine-level fingerprint spoofing - de-Googled, drop-in Playwright, fully buildable and verifiable from source.
Python · TypeScript · C#★ 31↓ 141/moJul 18, 2026
BSD-3-ClauseJul 18, 2026 · metrics 1.13.0
crates.io · PyPI
58Moderatehealth index
deedy5/primp
HTTP client that can impersonate web browser tls/http2 fingerprints
Rust★ 560↓ 2,133/moJul 21, 2026
MITJul 21, 2026 · metrics 1.13.0
npm · crates.io · Go +1
58Moderatehealth index
spider-rs/spider-clients
Python, Javascript, and Rust libraries for the Spider Cloud API.
Rust · Python · Go★ 26↓ 16.3K/moJul 16, 2026
MITJul 16, 2026 · metrics 1.13.0
npm
57Moderatehealth index
ashaychangwani/imprint
Record a browser workflow once, get a deterministic MCP tool your AI agent can call. Zero tokens at runtime. Postman for AI agents.
TypeScript★ 18↓ 2,525/moJul 23, 2026
MITJul 23, 2026 · metrics 1.13.0
npm
57Moderatehealth index
mysleekdesigns/crawlforge-mcp
26-tool MCP server for web scraping, crawling, deep research & autonomous extraction — clean Markdown & structured JSON for Claude, Cursor & any MCP client. 1,000 free credits, local-Ollama LLM support.
JavaScript★ 1↓ 2,975/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
PyPI
56Moderatehealth index
Kaliiiiiiiiii-Vinyzu/patchright-python
Undetected Python version of the Playwright testing and automation library.
Python★ 1,433Jul 21, 2026
Apache-2.0Jul 21, 2026 · metrics 1.13.0
npm
56Moderatehealth index
cherchyk/MCPBrowser
No repository description published.
JavaScript★ 8↓ 1,837/moJul 15, 2026
MITJul 15, 2026 · metrics 1.13.0
PyPI
55Moderatehealth index
dondai1234/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
Python · HTML★ 33↓ 4,672/moJul 18, 2026
MITJul 18, 2026 · metrics 1.13.0
Go
55Moderatehealth index
glim-sh/cuttle
Camouflage for browsers: a stealth-Chromium CDP farm where every fingerprint seed is its own undetectable browser (per-seed fingerprint, proxy, geo). Free forks, no proprietary binary.
Go★ 0Jul 20, 2026
MITJul 20, 2026 · metrics 1.13.0
npm
54Moderatehealth index
intoli/user-agents
A JavaScript library for generating random user agents with data that's updated daily.
TypeScript · JavaScript★ 1,181↓ 735.4K/moJul 15, 2026
Custom licenseJul 15, 2026 · metrics 1.13.0
Go · PyPI
54Moderatehealth index
joakimcarlsson/bonk
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
Go★ 13↓ 0/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
Go
52Moderatehealth index
tamnd/martinfowler-cli
Fetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal
Go · Python★ 0Jul 22, 2026
Apache-2.0Jul 22, 2026 · metrics 1.13.0
npm
51Moderatehealth index
Hyper-Solutions/hyper-sdk-js
JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.
TypeScript★ 54↓ 31.6K/moJul 21, 2026
MITJul 21, 2026 · metrics 1.13.0
PyPI
51Moderatehealth index
serpapi/google-search-results-python
Google Search Results via SERP API pip Python Package
Python★ 750↓ 1.6M/moJul 21, 2026
MITJul 21, 2026 · metrics 1.13.0
npm
51Moderatehealth index
webscraping-ai/webscraping-ai-mcp-server
A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities.
JavaScript★ 44↓ 560/moJul 22, 2026
No licenseJul 22, 2026 · metrics 1.13.0
NuGet
50Moderatehealth index
darrylwhitmore/NScrape
A web scraping framework for .NET
C#★ 66Jul 17, 2026
MITJul 17, 2026 · metrics 1.13.0
Go
49At riskhealth index
mjc-gh/virgo
Convert a webpage into plaintext or markdown using the Chrome DevTool Protocol
Go · JavaScript★ 1Jul 17, 2026
BSD-3-ClauseJul 17, 2026 · metrics 1.13.0
Go
48At riskhealth index
khanglvm/online
Online web discovery CLI for AI agents
Go★ 0Jul 17, 2026
MITJul 17, 2026 · metrics 1.13.0
Go
48At riskhealth index
leqwin/monloader
Online media downloader for monbooru
Go★ 3Jul 17, 2026
AGPL-3.0Jul 17, 2026 · metrics 1.13.0
npm
46At riskhealth index
NovadaLabs/novada-mcp
One MCP server for all web data — search, scrape, crawl, proxy, and AI research in a single npx install. Works with Claude, Cursor, and any MCP client.
TypeScript · HTML★ 2↓ 5,804/moJul 16, 2026
No licenseJul 16, 2026 · metrics 1.13.0
Go
45At riskhealth index
dhairya3391/kari
Kari (狩り) — hunt media from the terminal. Search, stream, and download anime, movies, TV shows & cartoons across 5+ providers with MPV/IINA/VLC/MX Player support, Trakt/AniList scrobbling, and auto-subtitles.
Go★ 27↓ 0/moJul 14, 2026
MITJul 14, 2026 · metrics 1.13.0
Packagist · PyPI
40At riskhealth index
php-curl-class/php-curl-class
PHP Curl Class makes it easy to send HTTP requests and integrate with web APIs
PHP★ 3,301↓ 140.4K/moJul 20, 2026
UnlicenseJul 20, 2026 · metrics 1.13.0
40At riskhealth index
vaaya-ai/vaaya-mcp
Vaaya MCP server — pay-per-call agent superpowers: media & video generation, product demo videos, web search & scraping, deep/market research, GTM & sales enrichment, code sandboxes, browser automation, email, memory. No API keys.
Shell★ 30Jul 19, 2026
MITJul 19, 2026 · metrics 1.13.0
PyPI
34At riskhealth index
rushter/selectolax
Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
Cython · Python★ 1,656Jul 20, 2026
MITJul 20, 2026 · metrics 1.13.0