#encoding

A high-performance tokenizer (BPE + SentencePiece) built with Rust with Python bindings, focused on speed, safety, and resource optimization.

Canonicalize and neutralize adversarial Unicode — homoglyph/bidi/zalgo/invisibles — before it reaches your classifiers, indexes, and identifiers

A zero-copy, strongly typed interface for arrow-rs

Pure Rust HDF5 library

Market data SDKs for ThetaData — Rust, Python, TypeScript, and C++. Historical, real-time streaming, and bulk flat-file access through one authenticated client. No JVM, no local terminal.

An ε-copy serialization/deserialization framework for Rust

Strongly typed YAML library for Rust

A memory efficient string type that can store up to 24* bytes on the stack

Cryptography-related format encoders/decoders: DER, PEM, PKCS, PKIX

Quick Data Format — fast, compact binary serialization for Go. encoding/json-style API, columnar per-column codecs, up to 68% smaller than Protobuf.

Cap'n Proto for Rust

Type that deserializes only from one specific value

Rust macro for generating flexible bitfields and bitflags, useful for low-level code (embedded or emulators).

A Rust crate for helping parse and rebuild binary data using ✨macro magic✨.

100% Safe Rust OpenEXR file library

A fast, zkVM-friendly SSZ library for Ethereum

Arbitrary precision decimals with lexicographically sortable byte encoding

Pure Rust GeoTIFF codec

A set of crates dedicated to parsing YAML.

A flexible Rust JSON library with no dependencies, no macros, no unsafe and optional no_std support

json-joy is a library that implements cutting-edge real-time and collaborative editing algorithms and utilities for JSON data models, with a focus on developing the JSON CRDT (Conflict-free Replicated Data Type) specification and implementation.

Self-improving agents, governed. Areev is the substrate for adaptive agents — agents that get better from their own history, under human authority, in steps you can inspect, undo, and re-measure.

A string type for Rust that is not required to be valid UTF-8.

An Avro Library that emphasizes testability and ease of use.

Type-erased Serialize, Serializer and Deserializer traits

A Gecko-oriented implementation of the Encoding Standard in Rust

BACnet 2020 - Rust core with full Rust and Python API

Bindings to Apple frameworks in Rust

Dependency-free, std-only FITS header reader/writer (parse + CRUD + serialize).

A Pest-based DBC lexical parser. The DBC format is used to exchange CAN network data.