sangaram / wav2vec2

0 stars 0 forks source link

the training loss in nan #1

Open DanMerry opened 2 months ago

DanMerry commented 2 months ago

The training loss is always nan, how to deal with it

sangaram commented 2 months ago

Thank you for raising the issue @DanMerry , I will find out what's wrong and fix it. But in order to work with Wav2Vec 2.0, I highly recommend you to use the implementation available on Hugging Face:

https://huggingface.co/facebook/wav2vec2-base-960h
https://huggingface.co/docs/transformers/tasks/asr

DanMerry commented 2 months ago

Thank you for your response. The issue seems to be the presence of NaNs in the input data. After removing the NaNs, a new problem has arisen: the loss does not seem to be decreasing. How should I address this issue?