triton-inference-server/pytriton · AI Repo StatsTRtriton-inference-server/pytriton
PyTriton is a Flask/FastAPI-like interface that simplifies Triton's deployment in Python environments.
Suy luận & chạy LLM cục bộPython Apache-2.0 65tạo 2022-11-08 #deep-learning#gpu#inference