pytorch/ao

PyTorch native quantization for training and inference

Inference & local LLMPython 683created 2023-11-03

Stars

3,027

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#brrr#cuda#dtypes#float8#inference#llama#mx#pytorch#quantization#sparsity#training#transformer

Top contributors

Not collected yet (contributors job).

pytorch/ao · AI Repo Stats