enable `find_executable_batch_size` on XPU

huggingface / accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

https://huggingface.co/docs/accelerate

Apache License 2.0

7.97k stars 970 forks source link

enable `find_executable_batch_size` on XPU #3236

Closed faaany closed 3 days ago

faaany commented 1 week ago

What does this PR do?

Currently, the find_executable_batch_size only works on CUDA and CPU. This PR adds the XPU support for this.

@muellerzr

HuggingFaceDocBuilderDev commented 1 week ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

faaany commented 3 days ago

Thanks for the correction! @BenjaminBossan