vllm-project/vllm · AI Repo StatsVLvllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
LLM & foundation modelsPython Apache-2.0 24.8Kcreated 2023-02-09 #amd#blackwell#cuda#deepseek#deepseek-v3#gpt#gpt-oss#inference#kimi#llama#llm#llm-serving#model-serving#moe#openai#pytorch#qwen#qwen3#tpu#transformer