huggingface / accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
https://huggingface.co/docs/accelerate
Apache License 2.0
7.66k stars 929 forks source link

Apex support #260

Open ZhiyuanChen opened 2 years ago

ZhiyuanChen commented 2 years ago

Hi, I'd like to ask the progress of apex support. If no one is doing it, I believe I could do something to help.

sgugger commented 2 years ago

No one is working on it for now, so if you want to tackle this, feel free to give it a go!

github-actions[bot] commented 2 years ago

This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.

Please note that issues that do not follow the contributing guidelines are likely to be ignored.