#text-processing

Source code spell checker

A collection of rust algorithms and data structures

Wherein we pursue oxidizing (context: https://github.com/googlefonts/oxidize) fontmake.

HarfBuzz port to Rust

A modern JavaScript library for handling Hangul characters.

A Rust library for PDF document manipulation.

A jq-like Markdown query language for command-line processing

☁️ The fastest HTML to markdown convertor on GitHub. Optimized for LLMs and supports streaming.

PyMuPDF is a high performance Python library for data extraction, analysis, conversion & manipulation of PDF (and other) documents.

Mermaid.js, but headless, in Rust.

Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.

A simple Python module for parsing human names into their individual components

Create ridiculously fast Lexers

Oniguruma's regex engine in pure Rust: full Oniguruma syntax, a vscode-oniguruma-compatible TextMate scanner, no C toolchain

High performance and CommonMark compliant HTML to Markdown converter. Maintained by the Kreuzberg team. Kreuzberg is a fast, polyglot document intelligence engine with a Rust core. It extracts structured data from 98+ document formats using streaming parsers and built-in OCR.

The fastest Office document library for Python, Rust, Go, JS/TS, C# and WASM. DOCX, XLSX, PPTX, DOC, XLS, PPT. Up to 100× faster than python-docx/openpyxl/python-pptx. 100% pass rate on valid Office files. MIT/Apache-2.0.

AI-writing humanizer for KO/EN/ZH/JA

Syntax Highlighter powered by Tree-sitter and Neovim themes.

Fast, flexible LLM inference

🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.

Rust library for regular expressions using "fancy" features like look-around and backreferences. Has a mode which aims to be compatible with Oniguruma syntax.

A multilingual morphological analysis library.

ripgrep recursively searches directories for a regex pattern while respecting your gitignore