Open antoche opened 1 year ago
Interesting! I'll try to find time soon to debug this
I think we haven't tested well yet with multi GPU setups. I won't have time to look into it anytime soon though I'm afraid. Gently pinging @patil-suraj @pcuenca and @williamberman here instead in case they have time
Looks interesting! Don't have immediate time but will add to my backlog
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
cc @williamberman is it still standing?
@patil-suraj yep still standing, haven't had time to look!
Describe the bug
Running the tests from the 0.6.0 tag, the accelerate tests fail with the following stack trace:
Similar error for
test_from_pretrained_accelerate
. All other run tests are passing.My machine has two GPUs in it. I'm guessing
accelerate
is trying to take advantage of both somehow, but the code expects all inputs on the same device.Reproduction
Simply run the tests on a machine with more than 1 CUDA device.
Logs
System Info