OpenNMT/CTranslate2 · AI Repo StatsOPOpenNMT/CTranslate2
Fast inference engine for Transformer models
Inference & local LLMC++ MIT 557created 2019-09-23 #avx#avx2#cpp#cuda#deep-learning#deep-neural-networks#gemm#inference#intrinsics#machine-translation#mkl#neon#neural-machine-translation#onednn#openmp#opennmt#parallel-computing#quantization#thrust#transformer-models