algorithmicsuperintelligence/optillm

Optimizing inference proxy for LLMs

LLM & foundation models Inference & local LLMActive (pushed in the last 90 days)Python Apache-2.0 401created 2024-08-22

GitHub

Stars

4,341

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#agent#agentic-ai#agentic-framework#agentic-workflow#agents#api-gateway#chain-of-thought#genai#large-language-models#llm#llm-inference#llmapi#mixture-of-experts#moa#monte-carlo-tree-search#openai#openai-api#optimization#prompt-engineering#proxy-server

Top contributors

Not collected yet (contributors job).