sail-sg/Adan · AI Repo StatsSAsail-sg/Adan
Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
Training & fine-tuningPython Apache-2.0 73created 2022-09-01 #adan#artificial-intelligence#bert-model#convnext#cuda-programming#deep-learning#diffusion#dreamfusion#fairseq#gpt2#llm-training#llms#mae#moe#optimizer#pytorch#resnet#timm#transformer-xl#vit