intel/intel-extension-for-transformers · AI Repo StatsINintel/intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
Chat apps & assistantsPython Apache-2.0 213created 2022-11-11archived #4-bits#autoround#chatbot#chatpdf#gaudi3#habana#intel-optimized-llamacpp#large-language-model#llm-cpu#llm-inference#neural-chat#neural-chat-7b#rag#retrieval#speculative-decoding#streamingllm