data-extraction — open-source software health

PyPI · npm

82Goodhealth index

Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.

Python · MDX★ 173Jul 20, 2026

Apache-2.0Jul 20, 2026 · metrics 1.13.0

PyPI

81Goodhealth index

d4vinci/scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

Python★ 69.4K↓ 863.2K/moJul 14, 2026

BSD-3-ClauseJul 14, 2026 · metrics 1.13.0

—

81Goodhealth index

mendableai/firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

TypeScript · Python★ 151.8KJul 16, 2026

AGPL-3.0Jul 16, 2026 · metrics 1.13.0

—

80Goodhealth index

firecrawl/firecrawl

The API to search, scrape, and interact with the web at scale. 🔥

TypeScript★ 149.9K↓ 0/moJul 13, 2026

AGPL-3.0Jul 13, 2026 · metrics 1.13.0

PyPI · crates.io · npm +5

78Goodhealth index

yfedoseev/pdf_oxide

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.

Rust★ 886↓ 226.3K/moJul 14, 2026

Apache-2.0Jul 14, 2026 · metrics 1.13.0

PyPI

70Goodhealth index

soxoj/socid-extractor

⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites

Python★ 1,038↓ 0/moJul 13, 2026

MITJul 13, 2026 · metrics 1.13.0

npm

69Moderatehealth index

Xquik-dev/tweetclaw

OpenClaw plugin to search tweets, search replies, post tweets, export followers, manage media, monitor X/Twitter, and run giveaway draws via Xquik. Not affiliated with X Corp.

TypeScript · JavaScript★ 89↓ 1,243/moJul 17, 2026

MITJul 17, 2026 · metrics 1.13.0

crates.io

69Moderatehealth index

bzsanti/oxidizePdf

Pure Rust PDF library for AI/RAG: structure-aware chunking, no ML, no C deps.

Rust★ 182↓ 6,045/moJul 13, 2026

MITJul 13, 2026 · metrics 1.13.0

crates.io · Go · npm +1

69Moderatehealth index

yfedoseev/office_oxide

The fastest Office document library for Python, Rust, Go, JS/TS, C# and WASM. DOCX, XLSX, PPTX, DOC, XLS, PPT. Up to 100× faster than python-docx/openpyxl/python-pptx. 100% pass rate on valid Office files. MIT/Apache-2.0.

Rust★ 68↓ 71K/moJul 13, 2026

Apache-2.0Jul 13, 2026 · metrics 1.13.0

64Moderatehealth index

xquik-dev/terraform-provider-x-twitter-scraper

Terraform provider for Xquik Twitter automation: manage monitors, webhooks, API keys, tweet actions, follower exports, draws and extraction jobs as infrastructure. Not affiliated with X Corp.

Go★ 0Jul 17, 2026

Apache-2.0Jul 17, 2026 · metrics 1.13.0

npm

62Moderatehealth index

xquik-dev/x-twitter-scraper

Xquik agent Skill for REST, OAuth-first MCP, webhooks, exports, tweet search, follower data, monitoring, and confirmation-gated publishing. Not affiliated with X Corp.

JavaScript★ 155↓ 1,004/moJul 17, 2026

MITJul 17, 2026 · metrics 1.13.0

61Moderatehealth index

Xquik-dev/x-twitter-scraper-go

Go REST SDK for Xquik: search posts, read profiles, export followers, download media, monitor accounts, publish, reply, and use webhooks. Not affiliated with X Corp.

Go★ 0Jul 17, 2026

Apache-2.0Jul 17, 2026 · metrics 1.13.0

crates.io · Go · npm +2

61Moderatehealth index

kreuzberg-dev/kreuzberg-lts

Kreuzberg v4 LTS — long-term support for the v4 line (legacy; superseded by xberg for v5+). MIT-licensed.

Rust★ 2↓ 0/moJul 13, 2026

MITJul 13, 2026 · metrics 1.13.0

npm · RubyGems

60Moderatehealth index

LeonTing1010/tap

Capture a logged-in browser task once — replay it forever at zero LLM tokens. Local-first browser-automation MCP for Claude Code, Cursor & any MCP host; credentials never leave your machine.

JavaScript · TypeScript★ 12Jul 17, 2026

MITJul 17, 2026 · metrics 1.13.0

60Moderatehealth index

xquik-dev/x-twitter-scraper-cli

Command-line REST client for Xquik: search posts, read profiles, export followers, download media, publish, reply, and manage webhooks. Not affiliated with X Corp.

Go★ 0Jul 17, 2026

Apache-2.0Jul 17, 2026 · metrics 1.13.0

npm · PyPI

59Moderatehealth index

ShZhao27208/Aut_Sci_Write

Academic research skills suite for AI Agent — literature search/download (WoS+Elsevier+Springer), PDF extraction, figure cropping, review writing, Zotero sync, and PPT/Html generation.

Python★ 165↓ 1,096/moJul 20, 2026

Custom licenseJul 20, 2026 · metrics 1.13.0

PyPI

58Moderatehealth index

SukramJ/openccu-data

Data-extraction pipeline and source-of-truth distribution for Homematic CCU configuration metadata — parses OCCU/RaspberryMatic TCL & JS into compact, typed JSON artifacts (easymodes, translations, profiles).

Python★ 0↓ 374.8K/moJul 19, 2026

MITJul 19, 2026 · metrics 1.13.0

npm

57Moderatehealth index

mysleekdesigns/crawlforge-mcp

26-tool MCP server for web scraping, crawling, deep research & autonomous extraction — clean Markdown & structured JSON for Claude, Cursor & any MCP client. 1,000 free credits, local-Ollama LLM support.

JavaScript★ 1↓ 2,975/moJul 14, 2026

MITJul 14, 2026 · metrics 1.13.0

NuGet

50Moderatehealth index

darrylwhitmore/NScrape

A web scraping framework for .NET

C#★ 66Jul 17, 2026

MITJul 17, 2026 · metrics 1.13.0

Packagist · PyPI

49At riskhealth index

cognesy/instructor-php

Unified LLM API, structured data outputs with LLMs, and agent SDK - in PHP

PHP★ 325↓ 5,250/moJul 20, 2026

MITJul 20, 2026 · metrics 1.13.0

npm

46At riskhealth index

NovadaLabs/novada-mcp

One MCP server for all web data — search, scrape, crawl, proxy, and AI research in a single npx install. Works with Claude, Cursor, and any MCP client.

TypeScript · HTML★ 2↓ 5,804/moJul 16, 2026

No licenseJul 16, 2026 · metrics 1.13.0

43At riskhealth index

idevelopthings/bdo-data-extractor

Fast Go CLI that decodes Black Desert client files (PAZ, .bss/.dbss, recipe XML, .loc etc) into clean JSON + item icons and more.

Go★ 1Jul 17, 2026

Custom licenseJul 17, 2026 · metrics 1.13.0

#data-extraction