mit-han-lab/TinyChatEngine

TinyChatEngine: On-Device LLM Inference Library

LLM & foundation modelsC++ MIT 102created 2023-05-24

Stars

974

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#arm#c#cpp#cuda-programming#deep-learning#edge-computing#large-language-models#on-device-ai#quantization#x86-64

Top contributors

Not collected yet (contributors job).

mit-han-lab/TinyChatEngine · AI Repo Stats