Question, during training score spike up

mit-han-lab / data-efficient-gans

[NeurIPS 2020] Differentiable Augmentation for Data-Efficient GAN Training

https://arxiv.org/abs/2006.10738

BSD 2-Clause "Simplified" License

1.27k stars 175 forks source link

Question, during training score spike up #81

Open aprilycliu opened 2 years ago

aprilycliu commented 2 years ago

Hi! I'd like to know in your experience, what cause the sudden spike up during the training. Thank you. Untitled

zsyzzsoft commented 2 years ago

I've experienced this issue occasionally. I'm not sure what is the root cause, but it usually becomes normal if you resume training from the checkpoint just before the sudden spike.