meta-pytorch/torchft · AI Repo StatsMEmeta-pytorch/torchft
Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
Huấn luyện & fine-tunePython 93tạo 2024-10-18 #consensus#diloco#distributed-systems#fault-tolerance#fsdp#hsdp#localsgd#ml#pytorch#torch#training