gitmylo / bark-voice-cloning-HuBERT-quantizer

The code for the bark-voicecloning model. Training and inference.
MIT License
670 stars 111 forks source link

german-HuBERT-quantizer_14_epoch.pth does not have all meta data #41

Closed FeU-aKlos closed 1 year ago

FeU-aKlos commented 1 year ago

If I try to call prepare2 with german-HuBERT-quantizer_14_epoch.pth checkpoint, the folloiwng error emerges:

File "/usr/local/lib/python3.10/dist-packages/fairseq/checkpoint_utils.py", line 585, in _upgrade_state_dict                                                                                │
    {"criterion_name": "CrossEntropyCriterion", "best_loss": state["best_loss"]}                                                                                                              │
KeyError: 'best_loss'  

If quantifier_hubert_base_ls960.pth checkpoint is used, everything works well.

Is there somewhere a checkpoint of german-HuBERT-quantizer_14_epoch.pth with the necessary metadata?

FeU-aKlos commented 1 year ago

I get the same error, when executing mode test

gitmylo commented 1 year ago

You're not supposed to load the quantifier as the hubert checkpoint, but instead load it as a quantizer model.