kvcache-ai/Mooncake · AI Repo StatsKVkvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
LLM & foundation modelsC++ Apache-2.0 1.5Kcreated 2024-06-25 #disaggregation#inference#kvcache#llm#rdma#reinforcement-learning#sglang#tokenspeed#trt-llm#vllm