[BUG] LFQ with DDP fails

lucidrains / vector-quantize-pytorch

Vector (and Scalar) Quantization, in Pytorch

MIT License

2.65k stars 215 forks source link

[BUG] LFQ with DDP fails #159

Closed hummat closed 2 months ago

hummat commented 2 months ago

Using LFQ with DDP fails with AttributeError: module 'torch.distributed' has no attribute 'nn'. Using from torch.distributed import nn as dist_nn seems to work, which is strange.

lucidrains commented 2 months ago

@hummat oops, fixed!