search

KinWaiCheuk / nnAudio

Audio processing by using pytorch 1D convolution network
MIT License
1.03k stars 89 forks source link

Mel_Basis kernel #114

Open gunikavashisht13472 opened 2 years ago

gunikavashisht13472 commented 2 years ago

Hello! While training my model, I used MelSpectrogram function and realized that after few epochs(15-10), the mel basis(mel filterbank) are stuck and donot change at all. I even tried increasing the learning rate and loss regularization. Could you let me know what is wrong with it?

KinWaiCheuk commented 2 years ago

The mel filterbanks should update according to the gradient. Can you compare the gradient for the mel filterbanks between the first few epochs and the epochs when it stops updating? I feel like that the gradient becomes zeros and hence it stops updating.