
adbar/htmldateFast and robust date extraction from web pages, with Python or on the command-line
Python★ 155↓ 15M/moAug 27, 2026
Python · C++★ 69↓ 18.7K/moOct 21, 2026

niieani/gpt-tokenizerThe fastest JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT models (gpt-5, gpt-o*, gpt-4o, etc.). Port of OpenAI's tiktoken with additional features.
TypeScript★ 845↓ 6.1M/moSep 18, 2026

yoshitomo-matsubara/torchdistillA coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
Python★ 1,634↓ 311/moOct 19, 2026

bretttolbert/verbeccVerbe Complete Conjugator (verbecc) supports Catalan, Spanish, French, Italian, Portuguese and Romanian and can predict conjugation for unknown verbs using Machine Learning
Python★ 107↓ 3,789/moAug 26, 2026
Python★ 377↓ 1,859/moOct 19, 2026

hankcs/HanLP中文分词 词性标注 命名实体识别 依存句法分析 成分句法分析 语义依存分析 语义角色标注 指代消解 风格转换 语义相似度 新词发现 关键词短语提取 自动摘要 文本分类聚类 拼音简繁转换 自然语言处理
Python · Jupyter Notebook★ 36.5K↓ 9,596/moOct 22, 2026
TypeScript★ 5↓ 4,590/moSep 26, 2026

mjpost/sacrebleuReference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons
Python★ 1,259↓ 4.3M/moAug 27, 2026

RasaHQ/rasa💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
Python★ 21.3KSep 16, 2026
PyPI · npm71Goodhealth index

explosion/thinc🔮 A refreshing functional take on deep learning, compatible with your favorite libraries
Python★ 2,890↓ 25.7M/moAug 27, 2026

TigreGotico/chronologiaReads dates written by humans in 40 languages, and reckons across 17 calendar systems — answers are spans, not instants, from deep time to next Tuesday. Refuses to guess when history cannot know.
Python★ 2↓ 25.4K/moSep 15, 2026
C++ · HTML★ 24Oct 22, 2026
npm63Moderatehealth index
JavaScript★ 1↓ 1,634/moOct 22, 2026
PyPI62Moderatehealth index

EmilStenstrom/conlluA CoNLL-U parser that takes a CoNLL-U formatted string and turns it into a nested python dictionary.
Python★ 323↓ 189.4K/moSep 12, 2026
NuGet62Moderatehealth index
C#★ 54Sep 15, 2026
PyPI · crates.io · Maven62Moderatehealth index
Java · Python★ 1↓ 8,207/moSep 15, 2026
PyPI60Moderatehealth index
Python · Cython★ 2↓ 7,478/moOct 16, 2026
PyPI59Moderatehealth index
Python★ 1,413Oct 20, 2026
PyPI57Moderatehealth index
Python★ 1,029Sep 17, 2026
RubyGems57Moderatehealth index
Ruby★ 4Oct 6, 2026
PyPI57Moderatehealth index
Python · TypeScript★ 1,293Sep 26, 2026
PyPI56Moderatehealth index

dongrixinyu/JioNLP中文 NLP 预处理、解析工具包,准确、高效、易用 A Chinese NLP Preprocessing & Parsing Package www.jionlp.com
Python★ 3,872Oct 16, 2026

gagolews/stringiFast and Portable Character String Processing in R (with the Unicode ICU)
C++ · C★ 318Sep 19, 2026

jdkato/prose:book: A Golang library for text processing, including tokenization, part-of-speech tagging, and named-entity extraction.
Go★ 3,091Sep 19, 2026
C++★ 273Sep 13, 2026
NuGet54Moderatehealth index

curiosity-ai/catalyst🚀 Catalyst is a C# Natural Language Processing library built for speed. Inspired by spaCy's design, it brings pre-trained models, out-of-the box support for training word and document embeddings, and flexible entity recognition models.
C#★ 860Sep 15, 2026
PyPI51Moderatehealth index

pemistahl/lingua-pyThe most accurate natural language detection library for Python, suitable for short text and mixed-language text
Python★ 1,796↓ 2.8M/moSep 17, 2026

datamade/usaddress:us: a python library for parsing unstructured United States address strings into address components
Python★ 1,637Sep 17, 2026
PyPI50Moderatehealth index

kpwhri/konsepyFramework for build NLP information extraction systems using regular expressions.
Python★ 1↓ 341/moOct 21, 2026