#llms

A convenient CLI to streamline LiteRT related development workflows, including converting, quantizing, compiling, managing, running, benchmarking and visualizing LiteRT (TFLite) models on various hardwares (CPU / GPU / NPU) across platforms (desktop, mobile or cloud).

Kura — the knowledgebase for humans and agents. Agent-native docs infrastructure, built on June.

A Typescript library to use LLM providers APIs in a unified way.

A documentation toolchain for plain CSS — TSDoc, for CSS.

Self-healing infrastructure for AI agent payments. 90.3% auto-recovery.

OramaCore is the complete runtime you need for your projects, answer engines, copilots, and search. It includes a fully-fledged full-text search engine, vector database, LLM interface, and many more utilities.

In-JVM small language model inference

Runtime for agentskills usage in go

[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

Docusaurus plugin for generating LLM-friendly documentation following the llmstxt.org standard

A PHP library for writing, reading, and validating llms.txt Markdown files.