thu-pacman/chitu · AI Repo StatsTHthu-pacman/chitu
High-performance inference framework for large language models, focusing on efficiency, flexibility, and availability.
LLM & foundation modelsPython Apache-2.0 251created 2025-02-20 #deepseek#gpu#llm#llm-serving#model-serving#pytorch