Packagist · Hex · crates.io +294Exceptionalhealth index
TypeScript · Python★ 161K↓ 3,278/moAug 4, 2026
PyPI91Excellenthealth index

adbar/trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/moAug 28, 2026
crates.io91Excellenthealth index

harehare/mqA jq-like Markdown query language for command-line processing
Rust★ 1,011↓ 4,589/moAug 22, 2026
npm · PyPI · crates.io87Excellenthealth index
us/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 518↓ 9,070/moAug 3, 2026
npm84Excellenthealth index

Nano-Collective/get-mdA fast, lightweight HTML to Markdown converter optimized for LLM consumption. Uses proven parsing libraries to deliver clean, well-structured markdown with intelligent content extraction and noise filtering.
TypeScript★ 88↓ 6,407/moAug 25, 2026

kinorai/omnifeedLLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
Go★ 6Sep 3, 2026
npm · crates.io · Packagist +178Goodhealth index
Rust★ 149↓ 685/moAug 1, 2026
npm · crates.io75Goodhealth index
0xMassi/webclawFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Rust★ 2,066↓ 424/moJul 26, 2026
HTML · JavaScript★ 11.4K↓ 28.5M/moAug 12, 2026
crates.io · npm · PyPI69Goodhealth index
nabbisen/mdka-rsA HTML to Markdown (MD) converter balances conversion quality with runtime efficiency.
Rust · JavaScript · Python★ 54↓ 5,080/moAug 3, 2026
npm · Go67Goodhealth index

giraffesyo/downmarkFast, pure-Go document-to-Markdown conversion for PDFs, Office files, HTML, CSV, ZIPs, and text—available as a CLI and modular library.
Go★ 0↓ 1,347/moSep 5, 2026
crates.io67Goodhealth index
Rust★ 26↓ 3,029/moAug 12, 2026
npm · Go67Goodhealth index
pinchtab/seaportalSeaPortal — Fast, HTTP-first content extraction for AI agents. No browser required.
Go · HTML★ 5↓ 207/moJul 17, 2026
npm63Moderatehealth index

mysleekdesigns/crawlforge-mcp28 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5,179/moSep 5, 2026
npm · crates.io · Go +163Moderatehealth index
Rust · Python · Go★ 26↓ 16.3K/moJul 16, 2026
mrusme/readerreader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI. (https://tty.fail/mrus/reader)
Go★ 409Jul 31, 2026
HTML★ 12↓ 103.9K/moSep 5, 2026
Go · PyPI41Weakhealth index
appautomaton/markmatonLightweight HTML-to-Markdown parser for AI agent workflows — Python CLI and API around a fast Go engine, available on PyPI.
Go · Python★ 4Aug 1, 2026

kasvith/htmdA fast HTML to Markdown converter for Elixir, powered by Rust
Elixir · Rust★ 41↓ 2,026/moAug 30, 2026