Closed blizda closed 3 years ago
Hey @blizda!
It should be fixed now. It was a simple 1 line change from
P_bar = Q/torch.sqrt(torch.tensor(self.dim).type(Q.type()))
to
P_bar = Q/torch.sqrt(torch.tensor(self.dim).type(Q.type())).to(Q.device)
Check it out with the latest commit or by downloading 0.19.3
from pip
Yes, this fix work, thanks
Hi, I trying to run informer training with DistributedDataParallel, and get error
Seems like this error connected with parameter sharing
Code for reproducing
Also, with DataParallel training going normal