ModelTC/LightCompress · AI Repo StatsMOModelTC/LightCompress
[EMNLP 2024 & AAAI 2026] A powerful toolkit for compressing large models including LLMs, VLMs, and video generative models.
LLM & foundation modelsPython Apache-2.0 84created 2024-03-06 #awq#benchmark#deepseek-v3#deployment#evaluation#internlm2#large-language-models#llm#mixtral#pruning#quantization#smoothquant#token-merging#token-pruning#token-reduction#tool#vllm#wan