FMInference/FlexLLMGen · AI Repo StatsFMFMInference/FlexLLMGen
Running large language models on a single GPU for throughput-oriented scenarios.
LLM & mô hình nền tảngPython Apache-2.0 588tạo 2023-02-15lưu trữ #deep-learning#gpt-3#high-throughput#large-language-models#machine-learning#offloading#opt