microsoft/vidur

Accurate, large-scale, and extensible simulator for LLM inference Systems

LLM & foundation modelsPython MIT 142created 2023-11-02

Stars

724

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#inference#llm#simulation#transformer#vllm

Top contributors

Not collected yet (contributors job).

microsoft/vidur · AI Repo Stats