#inference

A superfast proxy and smart load-balancer for AI Inference — virtualize models, share local and provider back-ends, optimal caching, lock-in sampling parameters, debug message flow and obtain OTel metrics

Small, dependency-free, fast Python package to infer binary file types checking the magic numbers signature

ローカルLLM（mlx / mlx-vlm / llama.cpp / router）を OpenAI 互換 API として起動・管理する軽量サーバー

Lightweight and friendly .NET library for realizing modern Semantic Web applications (OWL2, SWRL)

Provides building blocks to integrate with AI / LLM providers and built-in, common, providers.