raymin0223 / patch-mix_contrastive_learning

Patch-Mix Contrastive Learning with Audio Spectrogram Transformer on Respiratory Sound Classification (INTERSPEECH 2023)
60 stars 11 forks source link

Questions about val loss #7

Closed LWYgut closed 11 months ago

LWYgut commented 11 months ago

Hi, @raymin0223. Thank you for opensource code ! When I reproduced your code, I found that the validation curve kept increasing, and the training curve started to increase around 30 epochs. Additionally, I followed your code and the score I obtained was only 58.46. Are these situations normal? Thank you very much ! four_loss_源码

raymin0223 commented 11 months ago

Hi @LWYgut,

Thanks for your interests in our work! As I have never plotted the loss curves, I'm not sure, but I believe that train loss was always decreased. Also, val loss and accuracy were unstable and fluctuated a lot, and it seems like the issue might be due to the ICBHI dataset itself.

For your reproduced results, it looks weird if you use PatchMix CL loss. Checking issue #3 might be helpful.

LWYgut commented 11 months ago

Okay, I understand. Thank you for your reply. Wishing you success in your work!