apify/crawleeCrawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript · MDX★ 24.8KJul 19, 2026
PyPI · npm82Goodhealth index
apify/apify-sdk-pythonApify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Python · MDX★ 173Jul 20, 2026
cheeriojs/cheerioThe fast, flexible, and elegant library for parsing and manipulating HTML and XML.
TypeScript · HTML · Astro★ 30.4K↓ 121M/moJul 23, 2026
mendableai/firecrawlThe API to search, scrape, and interact with the web at scale. 🔥
TypeScript · Python★ 151.8KJul 16, 2026
firecrawl/firecrawlThe API to search, scrape, and interact with the web at scale. 🔥
TypeScript★ 149.9K↓ 0/moJul 13, 2026
apify/apify-sdk-jsApify SDK monorepo
MDX · TypeScript★ 180↓ 149.3K/moJul 20, 2026
adbar/trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,312Jul 18, 2026
jordantete/OddsHarvesterA python app designed to scrape and process sports betting data directly from oddsportal.com 🎯
Python · HTML★ 209Jul 20, 2026
npm69Moderatehealth index
Xquik-dev/tweetclawOpenClaw plugin to search tweets, search replies, post tweets, export followers, manage media, monitor X/Twitter, and run giveaway draws via Xquik. Not affiliated with X Corp.
TypeScript · JavaScript★ 89↓ 1,243/moJul 17, 2026
npm · RubyGems69Moderatehealth index
huginn/huginnCreate agents that monitor and act on your behalf. Your agents are standing by!
Ruby★ 49.6KJul 20, 2026
npm68Moderatehealth index
zerodytrash/TikTok-Live-ConnectorNode.js library to receive live stream events (comments, gifts, etc.) in realtime from TikTok LIVE.
TypeScript★ 2,080↓ 110.9K/moJul 21, 2026
npm67Moderatehealth index
MrAdex77/google-play-scraperGoogle Play scraper for Node.js with a fully typed TypeScript API. App details, search, top charts, reviews, permissions and data safety. A modern replacement for the unmaintained google-play-scraper.
TypeScript★ 5↓ 4,236/moJul 23, 2026
PyPI65Moderatehealth index
sdaqo/anipy-cliLittle tool in python to watch and download anime from the terminal (the better way to watch anime). Also applicable as an API
Python★ 486↓ 23.5K/moJul 19, 2026
Go · npm64Moderatehealth index
diadata-org/decentral-feederFeeder node for the Lumina oracle network, providing trustless and verifiable on-chain data.
Solidity★ 4Jul 22, 2026
PyPI63Moderatehealth index
jr200-labs/polars-hist-db(jetstream | file) --> polars dataframe <--> mariadb (bitemporal)
Python★ 1↓ 6,870/moJul 16, 2026
Maven62Moderatehealth index
fanyong920/jvppeteerJava API For Chrome and Firefox
Java★ 808Jul 17, 2026
npm · Go61Moderatehealth index
pinchtab/seaportalSeaPortal — Fast, HTTP-first content extraction for AI agents. No browser required.
Go · HTML★ 5↓ 207/moJul 17, 2026
npm61Moderatehealth index
stacksjs/ts-web-scraperA powerful, type-safe web scraping library for TypeScript.
TypeScript★ 11↓ 177.5K/moJul 21, 2026
npm · crates.io · Go +158Moderatehealth index
spider-rs/spider-clientsPython, Javascript, and Rust libraries for the Spider Cloud API.
Rust · Python · Go★ 26↓ 16.3K/moJul 16, 2026
wasylq/fssfss or Full Studio Scraper - scrape all videos metadata of your favourite performers or studios
Go★ 5↓ 0/moJul 13, 2026
Packagist57Moderatehealth index
boatracevibeproject/scraperBVP Scraper は、ボートレースの公式サイトから出走表、直前情報、オッズ、結果をスクレイピングするための PHP ライブラリです。
PHP★ 3↓ 9,665/moJul 18, 2026
npm57Moderatehealth index
mysleekdesigns/crawlforge-mcp26-tool MCP server for web scraping, crawling, deep research & autonomous extraction — clean Markdown & structured JSON for Claude, Cursor & any MCP client. 1,000 free credits, local-Ollama LLM support.
JavaScript★ 1↓ 2,975/moJul 14, 2026
npm56Moderatehealth index
cherchyk/MCPBrowserNo repository description published.
JavaScript★ 8↓ 1,837/moJul 15, 2026
kwadkore/ws-scraper[en.]ws-tcg.com scraper. Permanently forked from https://github.com/Akenaide/wsoffcli
HTML · Go★ 0Jul 23, 2026
tamnd/martinfowler-cliFetch Martin Fowler's technical articles, bliki posts, and book entries from the terminal
Go · Python★ 0Jul 22, 2026
tamnd/neuralnetworksdl-cliRead Neural Networks and Deep Learning book chapters and pages as JSON from the command line
Go · Python★ 0Jul 21, 2026
tamnd/thegradient-cliFetch The Gradient AI research publication posts and listings from the terminal
Go · Python★ 0Jul 21, 2026
tamnd/theodinproject-cliBrowse The Odin Project learning paths and lessons as JSON from the command line
Go · Python★ 0Jul 21, 2026
tamnd/usenix-cliFetch USENIX conference papers, proceedings, and talk metadata from the terminal
Go · Python★ 1Jul 21, 2026
tamnd/vldb-cliFetch VLDB conference papers, authors, and proceedings records from the terminal
Go · Python★ 0Jul 21, 2026