#web-scraping

AnchorBrowser-SDK-Typescript

AiO webtools for Pi: Search, Fetch, Pull | no API keys

HTTP client that can impersonate web browsers

Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

Official TypeScript/JavaScript SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Ships to npm, JSR, and Deno.

High-performance web crawling engine with bindings for 11 languages

🎭 Typescript HTTP client with native TLS, HTTP2, JA3, JA4 browser impersonation backed by wreq's Rust core

Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates with Selenium, Playwright, and Puppeteer via SDKs in Python, JavaScript, and C#.

Free proxies that actually work: 700+ sources, every hit verified (honeypots, injected scripts, TLS), a live list every hour, a rotating proxy server and an MCP server for AI agents.

Scrape transactions from Israeli banks and credit card companies with built-in Cloudflare WAF bypass (Camoufox + Playwright)

The official Node.js / Typescript library for the Steel API

Packages for Pi - extensions, skills, prompt templates, and themes.

CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents

Undetectable browser automation for AI agents via MCP. Stealth Chrome DevTools with smart profile management, anti-detection arg filtering, and CDP access.

Self-hosted web scraping and Markdown extraction for AI agents

Web research for your agents with smart and safe tooling + knowledge store

Cognitive Browser: The browser automation that thinks. Constitutional safety • Persona UX testing • Natural language interface • Self-healing selectors • Built for AI agents

Bright Data's JS SDK, use it to call bright data's scrape and search tools. bypass any Bot-detection or Captcha and extract data from the web.

Context.dev Go SDK: scrape any URL to LLM-ready markdown, crawl sites, search the web and extract structured JSON with one API key.

CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.

Concurrent, resumable job collection for Python with typed events, durable checkpoints, normalized models, and a DataFrame API.

A JavaScript library for generating random user agents with data that's updated daily.

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.

Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

该仓库未发布描述。

Golang Crawling and scraping framework

31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.

Anti-detection browser server for AI agents — REST API wrapping Camoufox engine with OpenClaw plugin support

A fast, friendly command line for Common Crawl: URL index search, WARC fetch, Parquet columnar queries, and dataset building.