ServerlessLLM/ServerlessLLM · AI Repo StatsSEServerlessLLM/ServerlessLLM
Serverless LLM Serving for Everyone.
LLM & mô hình nền tảngPython Apache-2.0 83tạo 2024-01-23 #cuda#huggingface-transformers#large-language-models#model-as-a-service#model-serving#pytorch#serverless-inference