Michael-A-Kuykendall/shimmy · AI Repo StatsMIMichael-A-Kuykendall/shimmy
⚡ Pure-Rust WebGPU inference engine — OpenAI-API compatible, GGUF native, runs on any GPU. No Python. No llama.cpp. Single binary.
Inference & local LLMRust Apache-2.0 589created 2025-08-28 #api-server#command-line-tool#developer-tools#gguf#huggingface#huggingface-models#huggingface-transformers#inference-server#llama#llamacpp#llm-inference#local-ai#machine-learning#ollama-api#openai-compatible#rust#rust-crate#transformers#webgpu#webgpu-shaders