flashinfer-ai/flashinfer · AI Repo StatsFLflashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
Inference & local LLMCuda Apache-2.0 1.8Kcreated 2023-07-22 #attention#cuda#distributed-inference#gpu#jit#large-large-models#llm-inference#moe#nvidia#pytorch