search

huggingface / accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
https://huggingface.co/docs/accelerate
Apache License 2.0
7.98k stars 975 forks source link

add the missing xpu for local sgd #3163

Closed faaany closed 3 weeks ago

faaany commented 1 month ago

What does this PR do?

As the tile suggests, local sgd also works on XPU.

HuggingFaceDocBuilderDev commented 1 month ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

faaany commented 1 month ago

I think the failed test is not relevant to my change in LocalSGD. Could you help retrigger the CI? Thanks a lot! @muellerzr