lucidrains/rotary-embedding-torch · AI Repo StatsLUlucidrains/rotary-embedding-torch
Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
RAG, memory & searchPython MIT 70created 2021-06-29 #artificial-intelligence#deep-learning#positional-encoding