ai-dynamo/dynamo · AI Repo StatsAIai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
Inference & local LLMRust 1.9Kcreated 2025-03-03 #diffusion#disaggregated-serving#kubernetes#llm-inference#omni#routing-engine#rust#sglang#tensorrt-llm#vllm