bentoml/OpenLLM · AI Repo StatsBEbentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
LLM & foundation modelsPython Apache-2.0 847created 2023-04-19 #bentoml#fine-tuning#llama#llama2#llama3-1#llama3-2#llama3-2-vision#llm#llm-inference#llm-ops#llm-serving#llmops#mistral#mlops#model-inference#open-source-llm#openllm#vicuna