lucidrains/native-sparse-attention-pytorch · AI Repo StatsLUlucidrains/native-sparse-attention-pytorch
Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper
Training & fine-tuningPython MIT 51created 2025-02-19 #artificial-intelligence#attention#deep-learning#sparse-attention