ironjr/grokfast

Official repository for the paper "Grokfast: Accelerated Grokking by Amplifying Slow Gradients"

Training & fine-tuningPython MIT 49created 2024-05-30

Stars

584

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#deep-learning#grokking#machine-learning#optimization#signal-processing

Top contributors

Not collected yet (contributors job).

ironjr/grokfast · AI Repo Stats