#web-scraping

AnchorBrowser-SDK-Typescript

AiO webtools for Pi: Search, Fetch, Pull | no API keys

HTTP client that can impersonate web browsers

Self-hosted SERP API for AI, SEO & automation. Browser-rendered Google, Bing, Yandex, Baidu, DuckDuckGo and Ecosia search with page extraction 🎉

Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.

Official TypeScript/JavaScript SDK for the Scrapfly platform: web scraping, screenshots, AI extraction, crawling, and a remote anti-bot browser. Ships to npm, JSR, and Deno.

High-performance web crawling engine with bindings for 11 languages

🎭 Typescript HTTP client with native TLS, HTTP2, JA3, JA4 browser impersonation backed by wreq's Rust core

Anti-detect browser for web scraping and automation. Engine-level fingerprint masking for Chromium and Firefox. Self-hosted, Docker-ready. Integrates with Selenium, Playwright, and Puppeteer via SDKs in Python, JavaScript, and C#.

Free proxies that actually work: 700+ sources, every hit verified (honeypots, injected scripts, TLS), a live list every hour, a rotating proxy server and an MCP server for AI agents.

Scrape transactions from Israeli banks and credit card companies with built-in Cloudflare WAF bypass (Camoufox + Playwright)

The official Node.js / Typescript library for the Steel API

Packages for Pi - extensions, skills, prompt templates, and themes.

CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents

Undetectable browser automation for AI agents via MCP. Stealth Chrome DevTools with smart profile management, anti-detection arg filtering, and CDP access.

Self-hosted web scraping and Markdown extraction for AI agents

Web research for your agents with smart and safe tooling + knowledge store

Cognitive Browser: The browser automation that thinks. Constitutional safety • Persona UX testing • Natural language interface • Self-healing selectors • Built for AI agents

Bright Data's JS SDK, use it to call bright data's scrape and search tools. bypass any Bot-detection or Captcha and extract data from the web.

Context.dev Go SDK: scrape any URL to LLM-ready markdown, crawl sites, search the web and extract structured JSON with one API key.

CLI, MCP server, and npm library that turns any website into an API — no docs, no SDK, no browser.

Concurrent, resumable job collection for Python with typed events, durable checkpoints, normalized models, and a DataFrame API.

A JavaScript library for generating random user agents with data that's updated daily.

Go HTTP client with browser-identical TLS/HTTP2 fingerprinting. Bypass bot detection by perfectly mimicking Chrome, Firefox, and Safari at the cryptographic level (JA3/JA4, Akamai fingerprint, header order). Supports HTTP/1.1, HTTP/2, HTTP/3, sessions, cookies, and proxies.

Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more

No repository description published.

Golang Crawling and scraping framework

31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.

Anti-detection browser server for AI agents — REST API wrapping Camoufox engine with OpenClaw plugin support

A fast, friendly command line for Common Crawl: URL index search, WARC fetch, Parquet columnar queries, and dataset building.