codefuse-ai/ModelCache

A LLM semantic caching system aiming to enhance user experience by reducing response time via cached query-result pairs.

LLM & foundation modelsPython 66created 2023-11-01

Stars

933

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#llm#semantic-cache

Top contributors

Not collected yet (contributors job).

codefuse-ai/ModelCache · AI Repo Stats