AGI-Arena/MARS

The official implementation of MARS: Unleashing the Power of Variance Reduction for Training Large Models

Training & fine-tuningPython Apache-2.0 49created 2024-11-17

Stars

725

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#fine-tuning#large-language-models#optimization-algorithms#optimizer#pretraining

Top contributors

Not collected yet (contributors job).

AGI-Arena/MARS · AI Repo Stats