Closed lambertjf closed 1 year ago
Get this error every time I want to train, about 30 minutes into training.
RuntimeError: DDP expects same model across all ranks, but Rank 2 has 128 params, while rank 0 has inconsistent 0 params.
I can't find anything about this error online really. Any ideas?
Sorry for replying in a closed issue. How do you solve the problem?
Get this error every time I want to train, about 30 minutes into training.
RuntimeError: DDP expects same model across all ranks, but Rank 2 has 128 params, while rank 0 has inconsistent 0 params.
I can't find anything about this error online really. Any ideas?