FMInference/FlexLLMGen · AI Repo StatsFMFMInference/FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
LLM & foundation modelsPython Apache-2.0 588created 2023-02-15archived #deep-learning#gpt-3#high-throughput#large-language-models#machine-learning#offloading#opt