lucidrains/mixture-of-experts · AI Repo StatsLUlucidrains/mixture-of-experts
A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models
Training & fine-tuningPython MIT 70created 2020-07-13 #artificial-intelligence#deep-learning#mixture-of-experts#transformer