deepspeedai/DeepSpeed-MII

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Training & fine-tuningPython Apache-2.0 192created 2022-03-23

Stars

2,118

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#deep-learning#inference#pytorch

Top contributors

Not collected yet (contributors job).

deepspeedai/DeepSpeed-MII · AI Repo Stats