alibaba/rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.

LLM & foundation modelsPython Apache-2.0 304created 2023-12-27

Stars

1,398

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#gpt#inference#llama#llm#llm-serving#llmops#model-serving

Top contributors

Not collected yet (contributors job).

alibaba/rtp-llm · AI Repo Stats