AviSoori1x/makeMoE · AI Repo StatsAVAviSoori1x/makeMoE
From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)
LLM & mô hình nền tảngJupyter Notebook MIT 96tạo 2024-01-22 #deep-learning#large-language-models#llm#mixture-of-experts#neural-networks#pytorch#pytorch-implementation