RahulSChand/gpu_poor · AI Repo StatsRARahulSChand/gpu_poor
Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization
LLM & foundation modelsJavaScript 88created 2023-09-12 #ggml#gpu#huggingface#language-model#llama#llama2#llamacpp#llm#pytorch#quantization