#web-scraping

Lighter web automation with Python

Official Go SDK for the Webclaw web extraction API

Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.

MCP server for web fetching with Cloudflare bypass, Trafilatura extraction, and smart routing. Free, self-hosted, no API keys.

Go library and CLI for extracting web page content — articles, metadata, and clean text from any URL

Automatic proxy pool for web scraping - crawls, validates, and rotates proxies with rate limiting and MITM support

Google Search Results via SERP API pip Python Package

Read and post to X from your own logged-in browser session, exposed to local AI agents over MCP. No X API keys required.

Web extraction runtime for browser-driven crawling and durable ingestion

Universal zero-dependency TypeScript SDK for the Zapi (Zest API) scraper platform

Online media downloader for monbooru

Read huggingface.co as data: every model, dataset, space, user, org, collection and paper as a typed record with an hf:// URI and a knowledge graph of the edges between them

Go-native browser automation via Chrome DevTools Protocol. No Node.js, no relay process, no external dependencies.

Go CLI for Reddit search & research: threads, subreddits, trends via web-session cookie — no API keys, no quota. Agent-friendly output.

Convert a webpage into plaintext or markdown using the Chrome DevTool Protocol

让 AI 代理访问互联网：抓取 · 爬取 · 搜索，内置反爬，$0 无密钥。Web research for AI agents: fetch, crawl & keyless search with anti-bot bypass.

Fetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal