AI4Bharat / IndicWav2Vec

Pretraining, fine-tuning and evaluation scripts for Indic-Wav2Vec2
https://indicnlp.ai4bharat.org/indicwav2vec
MIT License
82 stars 28 forks source link

Not able to load any checkpoint #5

Closed harveenchadha closed 2 years ago

harveenchadha commented 2 years ago

Hello,

I tried to load the hindi large checkpoint but none of the checkpoints are loading. Which version of fairseq was used for training?

I am getting the following error:

Screenshot 2022-01-26 at 12 33 42 AM
gowtham1997 commented 2 years ago

From the error, it looks like "sampling_alpha" is not defined. This is a variable we defined here for temperature based sampling.

Can you tell us how you are trying to load the checkpoint? Im guessing that you are missing to add common.user_dir=custom_task ( you need to pass custom_task folder where temp based sampling is implemented for fairseq to load this correctly)

harveenchadha commented 2 years ago

I am using sfi.py script from inference folder present here

gowtham1997 commented 2 years ago

Looking at our internal fairseq, there was one change we made to solve a similar issue earlier. I don't know if this is related.

The change was to make remove_missing=True in this line. Can you try to check if the loading works after you add this?

harveenchadha commented 2 years ago

Thank you.

This worked!