patchy631/time-to-first-token · AI Repo StatsPApatchy631/time-to-first-token
A 10-week, 30-minutes-a-day roadmap for LLM inference serving and optimization. vLLM, SGLang, quantization, speculative decoding, benchmarking.
Suy luận & chạy LLM cục bộHTML Apache-2.0 137tạo 2026-08-02 #learning-resources#llm#llm-inference#mlops#roadmap#sglang#vllm