apify/crawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript · MDX★ 26.2K↓ 6.8M/月2026年10月19日
apify/crawlee-pythonCrawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Python · MDX★ 9,535↓ 975.8K/月2026年9月17日
apify/apify-client-pythonApify API client for Python—Programmatically run Actors, manage and stream data from storages (datasets, key-value stores, request queues), schedule and monitor runs, and access the full Apify platform API. Sync and async interfaces with automatic retries and pagination.
Python★ 97↓ 2.8M/月2026年8月27日
apify/apify-sdk-pythonApify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Python · MDX★ 176↓ 232.6K/月2026年9月11日
D4Vinci/Scrapling🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ
Python★ 81.4K2026年9月16日
Python★ 31K2026年9月16日
PyPI · Packagist · crates.io +294卓越健康指数
TypeScript · Python★ 181.1K↓ 5.8M/月2026年9月16日
HTML★ 647↓ 23K/月2026年10月19日
plabayo/ramamodular service framework to move and transform network packets
Rust★ 1,244↓ 1.6M/月2026年10月21日
Python · HTML★ 17.6K↓ 6.8M/月2026年9月16日
Python · C++ · TypeScript★ 12.7K↓ 816.1K/月2026年10月22日
adbar/trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/月2026年8月28日
soxoj/maigret🕵️♂️ Collect a dossier on a person by username from 3000+ sites
Python · HTML★ 37.6K↓ 62.6K/月2026年9月16日
TypeScript · JavaScript★ 2,599↓ 2M/月2026年9月17日
feder-cr/invisible_playwrightPlaywright that anti-bots cannot see, so no captchas: same API, anti-detect stealth headless Firefox, undetected fingerprint, bypass bot detection, Python web scraping and browser automation.
Python★ 2,499↓ 32.3K/月2026年10月21日
tox-dev/turbohtmlA fast, fully typed HTML toolkit for Python. Escape, unescape, parse, select, and serialize HTML from one library, powered by a C-accelerated core.
C · Python★ 20↓ 30.3K/月2026年10月1日
yusufkaraaslan/Skill_SeekersConvert documentation websites, GitHub repositories, and PDFs into Claude AI skills with automatic conflict detection
Python★ 15K↓ 22.1K/月2026年9月19日
soxoj/socid-extractor⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
Python★ 1,089↓ 73.7K/月2026年9月18日
sqdshguy/wreq-jsHTTP client for Node.js with browser TLS fingerprint impersonation
TypeScript · Rust★ 402↓ 498.7K/月2026年9月23日
blisspixel/primrTurn any company URL into a strategic intelligence brief. Adaptive scraping + AI-powered research and synthesis.
Python★ 3↓ 2,172/月2026年9月11日
TypeScript★ 11.4K↓ 971/月2026年9月18日
getmaxun/maxun🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
TypeScript★ 17.5K2026年9月16日
jo-inc/camofox-browserStealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
JavaScript★ 8,924↓ 243.1K/月2026年8月28日
ZenRows/zenrows-python-sdkSDK to access Zenrows API directly from Python. We handle proxies rotation, headless browsers and CAPTCHAs for you.
Python★ 21↓ 211.5K/月2026年10月16日
achiya-automation/safari-mcpNative Safari browser automation for AI agents. 97 tools via AppleScript — zero overhead, keeps logins, runs silently in background. Drop-in alternative to Chrome DevTools MCP with 40-60% less CPU/heat on Apple Silicon.
JavaScript★ 183↓ 7,160/月2026年9月10日
KnockOutEZ/wigoloThe go-to web for your AI coding agent — local-first search, fetch, crawl & research over MCP. No API keys, no cloud, $0/query. Public beta.
TypeScript★ 5,237↓ 3,896/月2026年9月12日
byteface/domonicPython DOM and HTML toolkit - generate, parse and manipulate HTML/XML/SVG with CSS selectors, XPath, Web APIs and JavaScript-like utilities.
Python · HTML★ 160↓ 9,088/月2026年9月15日
Rust★ 2,790↓ 24.2K/月2026年10月20日
ArchiveBox/abx-dl⬇️ A simple all-in-one CLI tool to download EVERYTHING from a URL (like youtube-dl/yt-dlp, forum-dl, gallery-dl, simpler ArchiveBox). 🎭 Uses headless Chrome to get HTML, JS, CSS, images/video/audio/subtitles, PDFs, screenshots, article text, git repos, and more...
Python★ 142↓ 267.6K/月2026年9月11日
CloakHQ/CloakBrowserStealth Chromium that passes every bot detection test. Drop-in Playwright replacement with source-level fingerprint patches. 30/30 tests passed.
Python · C# · TypeScript★ 31.5K↓ 1.1M/月2026年9月16日