PyPI
D4Vinci/Scrapling
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!
BSD-3-ClauseAug 4, 2026 · metrics 2.10.0
All tags
Catalogue tag
#data-extraction
Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.
35 records
PyPI
ScrapeGraphAI/Scrapegraph-ai
Python scraper based on AI
MITAug 5, 2026 · metrics 2.10.0
PyPI · npm
apify/apify-sdk-python
Apify SDK for Python—The official library for building Apify Actors: serverless cloud programs for web scraping, browser automation, data processing, and AI agents. Manages the Actor lifecycle, storages (datasets, key-value stores, request queues), events, proxies, and pay-per-event monetization. Built on top of the the Apify API Client.
Apache-2.0Jul 20, 2026 · metrics 2.10.0
Packagist · Hex · crates.io +2
firecrawl/firecrawl
The context API to search, scrape, and interact with the web at scale. 🔥
AGPL-3.0Aug 4, 2026 · metrics 2.10.0
crates.io · PyPI · npm +5
yfedoseev/pdf_oxide
The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5× faster than industry leaders, 100% pass rate on 3,830 PDFs. MIT/Apache-2.0.
Apache-2.0Sep 5, 2026 · metrics 2.10.0
PyPI
soxoj/socid-extractor
⛏️ The extraction engine behind Maigret: turn any profile URL into a structured OSINT record across 150+ sites
MITAug 22, 2026 · metrics 2.10.0
npm · PyPI · crates.io
us/crw
Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
AGPL-3.0Aug 3, 2026 · metrics 2.10.0
crates.io · PyPI · npm +1
yfedoseev/office_oxide
The fastest Office document library for Python, Rust, Go, JS/TS, C# and WASM. DOCX, XLSX, PPTX, DOC, XLS, PPT. Up to 100× faster than python-docx/openpyxl/python-pptx. 100% pass rate on valid Office files. MIT/Apache-2.0.
Apache-2.0Aug 22, 2026 · metrics 2.10.0
npm
getmaxun/maxun
🔥 The open-source no-code platform for web scraping, crawling, search and AI data extraction • Turn websites into structured APIs in minutes 🔥
AGPL-3.0Aug 5, 2026 · metrics 2.10.0
crates.io
bzsanti/oxidizePdf
Pure Rust PDF library for AI/RAG: structure-aware chunking, no ML, no C deps.
MITAug 22, 2026 · metrics 2.10.0
Packagist · PyPI
cognesy/instructor-php
Unified LLM API, structured data outputs with LLMs, and agent SDK - in PHP
MITJul 20, 2026 · metrics 2.10.0
PyPI
thinh-vu/vnstock
A beginner-friendly yet powerful Python toolkit for financial analysis and automation — built to make modern investing accessible to everyone
Custom licenseJul 28, 2026 · metrics 2.10.0
npm
Xquik-dev/tweetclaw
OpenClaw plugin to search tweets, search replies, post tweets, export followers, manage media, monitor X/Twitter, and run giveaway draws via Xquik. Not affiliated with X Corp.
MITJul 17, 2026 · metrics 2.10.0
PyPI
Xquik-dev/x-twitter-scraper-python
Python REST SDK for Xquik tweet search, profiles, followers, media, publishing, and webhooks. Not affiliated with X Corp.
Apache-2.0Jul 26, 2026 · metrics 2.10.0
npm
brightdata/brightdata-mcp
A powerful Model Context Protocol (MCP) server that provides an all-in-one solution for public web access.
MITAug 28, 2026 · metrics 2.10.0
npm · crates.io
0xMassi/webclaw
Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
AGPL-3.0Jul 26, 2026 · metrics 2.10.0
npm
firecrawl/cli
CLI and Agent Skill for Firecrawl - Add scrape, search, and browsing capabilities to your AI agents
No licenseJul 26, 2026 · metrics 2.10.0
Go
xquik-dev/terraform-provider-x-twitter-scraper
Terraform provider for Xquik Twitter automation: manage monitors, webhooks, API keys, tweet actions, follower exports, draws and extraction jobs as infrastructure. Not affiliated with X Corp.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
—
extractus/article-extractor
To extract article from given URL
MITAug 28, 2026 · metrics 2.10.0
npm
scrape-badger/scrapebadger-node
Official Node.js SDK for ScrapeBadger - Async web scraping APIs for Twitter and more
MITSep 5, 2026 · metrics 2.10.0
Go
Xquik-dev/x-twitter-scraper-go
Go REST SDK for Xquik: search posts, read profiles, export followers, download media, monitor accounts, publish, reply, and use webhooks. Not affiliated with X Corp.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
Packagist · Go · crates.io +2
kreuzberg-dev/kreuzberg-lts
Kreuzberg v4 LTS — long-term support for the v4 line (legacy; superseded by xberg for v5+). MIT-licensed.
MITAug 22, 2026 · metrics 2.10.0
npm
xquik-dev/x-twitter-scraper
Xquik agent Skill for REST, OAuth-first MCP, webhooks, exports, tweet search, follower data, monitoring, and confirmation-gated publishing. Not affiliated with X Corp.
MITJul 17, 2026 · metrics 2.10.0
Go
xquik-dev/x-twitter-scraper-cli
Command-line REST client for Xquik: search posts, read profiles, export followers, download media, publish, reply, and manage webhooks. Not affiliated with X Corp.
Apache-2.0Jul 17, 2026 · metrics 2.10.0
npm · RubyGems
LeonTing1010/tap
Capture a logged-in browser task once — replay it forever at zero LLM tokens. Local-first browser-automation MCP for Claude Code, Cursor & any MCP host; credentials never leave your machine.
MITJul 17, 2026 · metrics 2.10.0
npm · PyPI
ShZhao27208/Aut_Sci_Write
Academic research skills suite for AI Agent — literature search/download (WoS+Elsevier+Springer), PDF extraction, figure cropping, review writing, Zotero sync, and PPT/Html generation.
Custom licenseJul 20, 2026 · metrics 2.10.0
npm
mysleekdesigns/crawlforge-mcp
28 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
MITSep 5, 2026 · metrics 2.10.0
PyPI
SukramJ/openccu-data
Data-extraction pipeline and source-of-truth distribution for Homematic CCU configuration metadata — parses OCCU/RaspberryMatic TCL & JS into compact, typed JSON artifacts (easymodes, translations, profiles).
MITJul 19, 2026 · metrics 2.10.0
PyPI
ivan-loh/messy-xlsx
Python library for parsing Excel files with structure detection and normalization
MITAug 30, 2026 · metrics 2.10.0
PyPI · npm
0m3rF/ELM-tool
Extract-Mask-Load tool between databases.
GPL-3.0Aug 15, 2026 · metrics 2.10.0