algorithmicsuperintelligence/optillm · AI Repo StatsALalgorithmicsuperintelligence/optillm
Optimizing inference proxy for LLMs
LLM & mô hình nền tảngPython Apache-2.0 401tạo 2024-08-22 #agent#agentic-ai#agentic-framework#agentic-workflow#agents#api-gateway#chain-of-thought#genai#large-language-models#llm#llm-inference#llmapi#mixture-of-experts#moa#monte-carlo-tree-search#openai#openai-api#optimization#prompt-engineering#proxy-server