huggingface / accelerate

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
https://huggingface.co/docs/accelerate
Apache License 2.0
7.97k stars 970 forks source link

take care of case when "_tied_weights_keys" is not an attribute #3226

Closed fabianlim closed 2 days ago

fabianlim commented 2 weeks ago

What does this PR do?

Address the issue pointed out by @enesmsahin on #3154

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR. @muellerzr @enesmsahin

HuggingFaceDocBuilderDev commented 1 week ago

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

fabianlim commented 3 days ago

Its abit strange that the test will fail given its such a small change @BenjaminBossan