Go
danieljustus/symaira-fetch
AI-native web fetch engine for LLM agents — browser impersonation, semantic DOM pipeline, MCP server. CGO-free Go.
Custom licenseJul 14, 2026 · metrics 2.10.0
All tags
Catalogue tag
#web-scraping
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
107 records
Go
dotcommander/defuddle
Go library and CLI for extracting web page content — articles, metadata, and clean text from any URL
MITJul 17, 2026 · metrics 2.10.0
npm
apmantza/pi-webaio
AiO webtools for Pi: Search, Fetch, Pull
MITJul 15, 2026 · metrics 2.10.0
PyPI
clearcotelabs/clearcote-browser
Open-source stealth Chromium 149 with engine-level fingerprint spoofing - de-Googled, drop-in Playwright, fully buildable and verifiable from source.
BSD-3-ClauseJul 18, 2026 · metrics 2.10.0
crates.io · PyPI
deedy5/primp
HTTP client that can impersonate web browser tls/http2 fingerprints
MITJul 21, 2026 · metrics 2.10.0
npm
mysleekdesigns/crawlforge-mcp
28 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
MITSep 5, 2026 · metrics 2.10.0
RubyGems
serpapi/nokolexbor
High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.
No licenseJul 24, 2026 · metrics 2.10.0
npm · crates.io · Go +1
spider-rs/spider-clients
Python, Javascript, and Rust libraries for the Spider Cloud API.
MITJul 16, 2026 · metrics 2.10.0
PyPI
mherrmann/helium
Lighter web automation with Python
MITAug 2, 2026 · metrics 2.10.0
PyPI
stayukasabov/capcat
v2.0.33 | Personal news archiving utility: 12 built-in sources to Markdown + HTML. URL deduplication, chronological ordering, date-aware frontmatter, ethical scraping.
Custom licenseAug 28, 2026 · metrics 2.10.0
Go
tamnd/ccrawl-cli
A fast, friendly command line for Common Crawl: URL index search, WARC fetch, Parquet columnar queries, and dataset building.
Apache-2.0Aug 9, 2026 · metrics 2.10.0
npm · PyPI
Bin-Huang/camoufox-cli
Anti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no bot-detectable Playwright leaks
MITJul 28, 2026 · metrics 2.10.0
PyPI
Ge0rg3/requests-ip-rotator
A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.
GPL-3.0Aug 4, 2026 · metrics 2.10.0
npm
ashaychangwani/imprint
Record a browser workflow once, get a deterministic MCP tool your AI agent can call. Zero tokens at runtime. Postman for AI agents.
MITJul 23, 2026 · metrics 2.10.0
npm
brandonkramer/pi-scraper
Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.
MITAug 28, 2026 · metrics 2.10.0
npm
cherchyk/MCPBrowser
No repository description published.
MITJul 15, 2026 · metrics 2.10.0
Go
glim-sh/cuttle
Camouflage for browsers: a stealth-Chromium CDP farm where every fingerprint seed is its own undetectable browser (per-seed fingerprint, proxy, geo). Free forks, no proprietary binary.
MITJul 20, 2026 · metrics 2.10.0
PyPI
Kaliiiiiiiiii-Vinyzu/patchright-python
Undetected Python version of the Playwright testing and automation library.
Apache-2.0Jul 21, 2026 · metrics 2.10.0
PyPI
dondai1234/master-fetch
MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.
MITJul 18, 2026 · metrics 2.10.0
Go · PyPI
JoakimCarlsson/bonk
Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.
MITAug 22, 2026 · metrics 2.10.0
Go · npm
pithecene/quarry
Web extraction runtime for browser-driven crawling and durable ingestion
Apache-2.0Aug 23, 2026 · metrics 2.10.0
npm
yansircc/pipee
Pipee — Web UI for Pi and its official extensions
No licenseAug 1, 2026 · metrics 2.10.0
Go
Dhairya3391/kari
Kari just a tui for getting media from providers and playing it in your media player with nice to have features.
MITSep 5, 2026 · metrics 2.10.0
PyPI
feder-cr/invisible_core
Seed to browser fingerprint to Firefox prefs. The config core behind an undetected, anti-detect Firefox. Pure Python, zero Playwright.
MITAug 1, 2026 · metrics 2.10.0
Go
tamnd/hf-cli
Read huggingface.co as data: every model, dataset, space, user, org, collection and paper as a typed record with an hf:// URI and a knowledge graph of the edges between them
Apache-2.0Sep 7, 2026 · metrics 2.10.0
Go
tamnd/martinfowler-cli
Fetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal
Apache-2.0Jul 22, 2026 · metrics 2.10.0
Go
0xMassi/webclaw-go
Official Go SDK for the Webclaw web extraction API
MITJul 24, 2026 · metrics 2.10.0
npm
Hyper-Solutions/hyper-sdk-js
JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.
MITJul 21, 2026 · metrics 2.10.0
PyPI
serpapi/google-search-results-python
Google Search Results via SERP API pip Python Package
MITJul 21, 2026 · metrics 2.10.0
npm
webscraping-ai/webscraping-ai-mcp-server
A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities.
No licenseJul 22, 2026 · metrics 2.10.0