efeslab/Nanoflow

A throughput-oriented high-performance serving framework for LLMs

LLM & foundation modelsJupyter Notebook 55created 2024-08-19

Stars

978

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#cuda#inference#llama2#llm#llm-serving#model-serving

Top contributors

Not collected yet (contributors job).

efeslab/Nanoflow · AI Repo Stats