llm-d/llm-d · AI Repo StatsLLllm-d/llm-d
State of the art inference performance with modern accelerators on Kubernetes
LLM & mô hình nền tảngPython Apache-2.0 932tạo 2025-04-29 #ai#cncf#distributed-inference#gpu#inference#intelligent-routing#kubernetes#llm#model-server