[DRAFT] More efficient multi-gpu tests

huggingface / accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

https://huggingface.co/docs/accelerate

Apache License 2.0

7.34k stars 875 forks source link

[DRAFT] More efficient multi-gpu tests #2815

Closed muellerzr closed 4 weeks ago

muellerzr commented 1 month ago

DO NOT MERGE!

HuggingFaceDocBuilderDev commented 1 month ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.