intel/auto-round

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率，量化感知训练的精度

Inference & local LLMPython Apache-2.0 201created 2024-01-04

Stars

1,703

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#diffusers#gguf#int4#llms#mxfp4#nvfp4#omni#quantization#rounding#sglang#transformers#vllm#vlms

Top contributors

Not collected yet (contributors job).

intel/auto-round · AI Repo Stats