Open RohollahHS opened 5 months ago
In the paper you said that you reset the codebook every 20 iterations to prevent codebook collapse. However, in the training loop https://github.com/exitudio/MMM/blob/68d850095a0640405c0d1deb1fc101f11b386736/train_vq.py#L156-L193, I did not find any thing regarding reseting codebook. Could you please clarify this?
Hi, We reset codebook in quantization process here.
In the paper you said that you reset the codebook every 20 iterations to prevent codebook collapse. However, in the training loop https://github.com/exitudio/MMM/blob/68d850095a0640405c0d1deb1fc101f11b386736/train_vq.py#L156-L193, I did not find any thing regarding reseting codebook. Could you please clarify this?