PyPI · Packagist · crates.io +294Exceptionalhealth index
TypeScript · Python★ 181.1K↓ 5.8M/moSep 16, 2026
PyPI91Excellenthealth index

adbar/trafilaturaPython & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
Python★ 6,718↓ 14M/moAug 28, 2026
crates.io · npm · PyPI91Excellenthealth index

fastcrw/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,095↓ 10.6K/moOct 2, 2026
crates.io91Excellenthealth index

harehare/mqA jq-like Markdown query language for command-line processing
Rust★ 1,062↓ 6,629/moOct 20, 2026
crates.io · npm · PyPI91Excellenthealth index

us/crwFast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.
Rust★ 1,032↓ 10.7K/moSep 16, 2026
npm · Packagist · crates.io +189Excellenthealth index

xberg-io/html-to-markdownHigh performance and CommonMark compliant HTML to Markdown converter. Maintained by the Kreuzberg team. Kreuzberg is a fast, polyglot document intelligence engine with a Rust core. It extracts structured data from 98+ document formats using streaming parsers and built-in OCR.
HTML · Rust★ 869↓ 1,033/moSep 14, 2026
npm · crates.io87Excellenthealth index

0xMassi/webclawFast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.
Rust★ 2,343↓ 1,301/moSep 13, 2026
npm84Excellenthealth index

Nano-Collective/get-mdA fast, lightweight HTML to Markdown converter optimized for LLM consumption. Uses proven parsing libraries to deliver clean, well-structured markdown with intelligent content extraction and noise filtering.
TypeScript★ 88↓ 6,407/moAug 25, 2026
Go80Excellenthealth index

kinorai/omnifeedLLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible
Go · HTML★ 10Oct 21, 2026
HTML · JavaScript★ 11.4K↓ 33.1M/moSep 17, 2026
npm · Packagist · crates.io +178Goodhealth index
Rust★ 173↓ 1,094/moSep 15, 2026
NuGet · npm75Goodhealth index
HTML★ 399Sep 14, 2026

context-dot-dev/context-go-sdkContext.dev Go SDK: scrape any URL to LLM-ready markdown, crawl sites, search the web and extract structured JSON with one API key.
Go★ 1Oct 20, 2026
npm · Go69Goodhealth index

giraffesyo/downmarkFast, pure-Go document-to-Markdown conversion for PDFs, Office files, HTML, CSV, ZIPs, and text—available as a CLI and modular library.
Go★ 1↓ 609/moOct 22, 2026
crates.io69Goodhealth index
Rust★ 26↓ 2,408/moSep 17, 2026

mysleekdesigns/crawlforge-mcp31 MCP tools that give Claude, Cursor and any MCP client the live web — scrape, crawl, search, real Google rank, change tracking, document parsing, plus an autonomous agent that researches from a plain-English prompt with no URLs. Clean Markdown and schema-validated JSON, not raw HTML. Local-Ollama extraction by default. MIT, 1,000 free credits.
JavaScript★ 2↓ 5,464/moOct 21, 2026
PyPI · crates.io · npm69Goodhealth index

nabbisen/mdka-rsA HTML to Markdown (MD) converter balances conversion quality with runtime efficiency.
Rust · JavaScript★ 55↓ 6,238/moSep 16, 2026
PyPI · Go65Goodhealth index

appautomaton/markmatonLightweight HTML-to-Markdown parser for AI agent workflows — Python CLI and API around a fast Go engine, available on PyPI.
Go · Python★ 5↓ 112/moSep 15, 2026
PyPI · npm · crates.io +162Moderatehealth index
Rust · Python · Go★ 26↓ 365K/moSep 9, 2026

mrusme/readerreader is for your command line what the “readability” view is for modern browsers: A lightweight tool offering better readability of web pages (and EML files!) on the CLI. (https://tty.fail/mrus/reader)
Go★ 413Sep 15, 2026
npm · Go60Moderatehealth index

pinchtab/seaportalSeaPortal — Fast, HTTP-first content extraction for AI agents. No browser required.
Go · HTML★ 3↓ 31/moSep 9, 2026
npm50Moderatehealth index
HTML★ 13↓ 95.6K/moOct 21, 2026

kasvith/htmdA fast HTML to Markdown converter for Elixir, powered by Rust
Elixir · Rust★ 43↓ 6,127/moOct 21, 2026
JavaScript · HTML★ 12↓ 129.4K/moOct 15, 2026