PaddlePaddle/FastDeploy

High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle

LLM & foundation modelsPython Apache-2.0 757created 2022-06-27

Stars

3,723

1-day growth

—

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

The chart appears after at least 2 days of data.

#ernie#ernie-45#ernie-45-vl#inference#llm#llm-serving#openai#serving#vllm

Top contributors

Not collected yet (contributors job).

PaddlePaddle/FastDeploy · AI Repo Stats