cactus-compute/engine · AI Repo StatsCAcactus-compute/engine
2bit quants, kernels and runtime for consumer devices.
LLM & foundation modelsC++ 515created 2025-04-23 #ai#android#arm#edge#edge-ai#framework#ios#llamacpp#llm#llm-inference#llms#mobile#mobile-inference#on-device-ai#quantiz#rag#smartphone#speech#transformer#whisper