#web-scraping

AiO webtools for Pi: Search, Fetch, Pull

Open-source stealth Chromium 149 with engine-level fingerprint spoofing - de-Googled, drop-in Playwright, fully buildable and verifiable from source.

HTTP client that can impersonate web browser tls/http2 fingerprints

28 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.

High-performance HTML5 parser for Ruby based on Lexbor, with support for both CSS selectors and XPath.

Python, Javascript, and Rust libraries for the Spider Cloud API.

Lighter web automation with Python

v2.0.33 | Personal news archiving utility: 12 built-in sources to Markdown + HTML. URL deduplication, chronological ordering, date-aware frontmatter, ethical scraping.

A fast, friendly command line for Common Crawl: URL index search, WARC fetch, Parquet columnar queries, and dataset building.

Anti-detect browser automation CLI & Skills for AI agents — Camoufox-powered fingerprint spoofing, no bot-detectable Playwright leaks

A Python library to utilize AWS API Gateway's large IP pool as a proxy to generate pseudo-infinite IPs for web scraping and brute forcing.

Record a browser workflow once, get a deterministic MCP tool your AI agent can call. Zero tokens at runtime. Postman for AI agents.

Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.

该仓库未发布描述。

Camouflage for browsers: a stealth-Chromium CDP farm where every fingerprint seed is its own undetectable browser (per-seed fingerprint, proxy, geo). Free forks, no proprietary binary.

Undetected Python version of the Playwright testing and automation library.

MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.

Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.

Web extraction runtime for browser-driven crawling and durable ingestion

Pipee — Web UI for Pi and its official extensions

Kari just a tui for getting media from providers and playing it in your media player with nice to have features.

Seed to browser fingerprint to Firefox prefs. The config core behind an undetected, anti-detect Firefox. Pure Python, zero Playwright.

Read huggingface.co as data: every model, dataset, space, user, org, collection and paper as a typed record with an hf:// URI and a knowledge graph of the edges between them

Fetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal

Official Go SDK for the Webclaw web extraction API

JavaScript / TypeScript SDK for Bot Protection Bypass - Automate Akamai, Incapsula, Kasada, and DataDome. No browsers required. Solve challenges and generate valid sensors/cookies via API.

Google Search Results via SERP API pip Python Package

A Model Context Protocol (MCP) server implementation that integrates with WebScraping.AI for web data extraction capabilities.