#scraping

Capture a logged-in browser task once — replay it forever at zero LLM tokens. Local-first browser-automation MCP for Claude Code, Cursor & any MCP host; credentials never leave your machine.

Get info from any web service or page

KRX 주식 정보 스크래핑

Browser automation CLI — wraps cdpwave and bidiwave, no Node.js, no Chromium download. CDP & WebDriver BiDi backends, 80+ commands, async core, serve mode, session recording.

Headless browser library and HTTP server for Go: one interface over Rod and remote CDP, 27-action automation API, fingerprint leak patches, humanized input, and a self-test harness against public bot detectors.

Extract readable content, comments, and metadata from web pages

Official AnyAPI SDKs for TypeScript and Python - typed access to hundreds of scraping and data APIs through one key, USD pay-per-request.

proper Trade Republic library providing accounts / assets / transactions / live updates session

Generic anti-ban toolkit for Go: 29 browser TLS fingerprint profiles, proxy rotation with health tracking, rate limiting, retry/backoff, sessions, and a generic pool. Drop-in http.RoundTripper, not a scraping framework.

Rust port of readability — extract readable content from HTML

nodejs SDK of the Olostep API

Pipe the public internet: Unix commands that turn feeds, APIs and web pages into events, detect what changed, and publish free hosted feeds. Yahoo Pipes, rebuilt for the terminal.

Pi extension for fast page scraping, recursive crawling, URL/site mapping, brand extraction, content diffing, PDF text extraction, and deterministic vertical extraction.

🧹 Python package for text cleaning

The library provides convenient access to the Outscraper API from applications written in the Ruby language. Allows using Outscraper's services from your code.

fast multi-provider web search & full page scrape cli for agents

Bulk job-board scraper with 100+ sites, email enrichment, deterministic quality scoring, and multi-format exports (CSV/JSONL/XLSX/Parquet). Designed for scheduled bulk-first operations with per-site rate limiting, proxy pools, and resume support.

Google Search Results via SERP API pip Python Package

Curated list of common web crawler and bot User-Agent strings used across the internet.

Pull current and historical baseball statistics using Python (Statcast, Baseball Reference, FanGraphs)

The Modern Google Trends API - Combining the best features from pytrends, trendspyg, and more.

A lightweight .NET library to download YouTube videos.

TikTok LIVE API Client - The #1 Worldwide freemium SaaS API for TikTok LIVE data retrieval, offered in all major languages!

Twitter/X scraping library for Go with anti-ban, account pool, xtid, and CAPTCHA support

该仓库未发布描述。

Go CLI for Reddit search & research: threads, subreddits, trends via web-session cookie — no API keys, no quota. Agent-friendly output.