#nlp

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

LlamaIndex is the document processing platform for AI

LangSmith Client SDK Implementations

Ongoing research training transformer models at scale

Thai natural language processing in Python

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

🤗 The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation tools

State-of-the-Art Embeddings, Retrieval, and Reranking

Neural Network Compression Framework for enhanced OpenVINO™ inference

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

ModelScope: bring the notion of Model-as-a-Service to life.

Apache OpenNLP

Pretrained model hub for Keras 3.

textlint is the pluggable linter for natural language text.

SDK for the development of custom actions for Rasa

The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 2,200+ medical models, 21 languages, Apple MLX + Python, no cloud, no patient data leaving your network. Apache-2.0

Python scraper based on AI

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

A Python library for extracting structured information from unstructured text using LLMs with precise source grounding and interactive visualization.

Fast, Flexible and Portable Structured Generation

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows