lucidrains/linear-attention-transformer · AI Repo StatsLUlucidrains/linear-attention-transformer
Transformer based on a variant of attention that is linear complexity in respect to sequence length
Training & fine-tuningPython MIT 78created 2020-06-04 #artificial-intelligence#attention-mechanism#deep-learning#pytorch#transformer