search

kai-wen-yang / CD-VAE

[NeurIPS 2021] "Class-Disentanglement and Applications in Adversarial Detection and Defense"
MIT License
43 stars 8 forks source link

ask the optimizer and learning rate attenuation strategy about VQvae #7

Closed GANG370 closed 2 years ago

GANG370 commented 2 years ago

When you use VQ-vae for high-precision picture training, how do you set the optimizer and learning rate? I did not get good results when I used the optimizer and learning rate attenuation strategy in your original paper. Please help me, thank you very much

kai-wen-yang commented 2 years ago

I use the same optimizer and learning rate scheduler, i.e., AdamW and ConsineAnnealingLR.