All tags
Catalogue tag

#efficient-llms

Every repository in the public record carrying this tag — from its GitHub topics or the keywords its package registries publish. Health is measured under the same versioned methodology as the rest of the record.

1 record
Tagged “efficient-llms”Ranked by health index
PyPI
55Moderatehealth index
microsoft/LLMLingua
[EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Python★ 6,584Aug 19, 2026
MITAug 19, 2026 · metrics 2.10.0