AI Repo
Stats
Repos
Categories
Developers
Countries
EN
Tiiny-AI/PowerInfer · AI Repo Stats
Repos
Categories
Developers
Countries
VI
EN
TI
Tiiny-AI/
PowerInfer
High-speed Large Language Model Serving for Local Deployment
LLM & foundation models
C++
MIT
618
created 2023-12-15
GitHub
#large-language-models
#llama
#llm
#llm-inference
#local-inference