#text-processing

🛠️ ASIMOV Command-Line Interface (CLI).

*Very* fast recursive file walking and globbing library for Zig, C, and Rust. With gitignore support. 100% POSIX compatible

Regex engine specialized in tokenization and LLM text processing

A pure rust library for reading and writing spreadsheet files

LaTeX language server, formatter, and linter

Detecting CSV file dialects by Table Uniformity Measurement and Data Type Inference

The Jieba Chinese Word Segmentation Implemented in Rust

A high-performance tokenizer (BPE + SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

Canonicalize and neutralize adversarial Unicode — homoglyph/bidi/zalgo/invisibles — before it reaches your classifiers, indexes, and identifiers

Fast typo-resistant fuzzy matching via SIMD smith waterman, similar algorithm to FZF

A memory efficient string type that can store up to 24* bytes on the stack

Streamlining Text Processing

An mdbook linting tool

Convert PDF documents to Markdown using Vision Language Models — CLI and library

A string type for Rust that is not required to be valid UTF-8.

Rust port of the Charm ecosystem (Bubble Tea, Lip Gloss, Bubbles, Wish): Elm-architecture TUIs, CSS-like terminal styling, and SSH app framework

Efficiently-updatable double-array trie in Rust (ported from cedar)

🦀 ASIMOV Software Development Kit (SDK) for Rust: A polyglot development platform for trustworthy neurosymbolic machine intelligence.

Fast pattern-matching library for filtering JSON events, now in rust.

Tools for finding and manipulating differences between files

A powerful utility for transforming text to title case with support for multiple style guides and extensive customization options.

Full Rust port of Python docling

Local proxy that compresses your LLM API requests so you pay less, with no change to the answers. Trims wasted tokens from prompts, history, tool output, and code before they're sent: -31% input / -74% output, measured live. Any provider, no extra model calls. Also an MCP server and embeddable library (Rust, Python, Ruby, Kotlin, Swift, JS/TS).

A Gecko-oriented implementation of the Encoding Standard in Rust