meta-pytorch/torchft

Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)

Training & fine-tuningPython 93created 2024-10-18

Stars

553

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#consensus#diloco#distributed-systems#fault-tolerance#fsdp#hsdp#localsgd#ml#pytorch#torch#training

Top contributors

Not collected yet (contributors job).

meta-pytorch/torchft · AI Repo Stats