SJTMusicTeam / Muskits

An opensource music processing toolkit
Apache License 2.0
312 stars 44 forks source link

English demo? #139

Open impactcolor opened 1 year ago

impactcolor commented 1 year ago

Thank you for sharing the colab notebook. Is there an example of english demo? In the current colab I have done the following:

I changed pretrained acoustic model to this: config_path = "downloads/zh/muskit/exp/svs_with_lid/config.yaml" model_path = "downloads/zh/muskit/exp/svs_with_lid/119epoch.pth"

Which is from: Multilingual_four

Then I changed pretrained vcoder to this: vocoder_config = "downloads/zh/pwg/config.yml" vocoder_checkpoint = "downloads/zh/pwg/checkpoint-1000000steps.pkl" print("successfully finished download vocoder")

Which is one of the models from results.
The final blocks gives me the error: 31 batch = sing_generation.preprocess_fn(str(row["id"]), info, 1.0) 32 batch = tensorify(batch) ---> 33 singing, _, _, _, _, _, _ = sing_generation(**batch)

I'm obviously doing something wrong. Can you give me any insight into how to do english models can be loaded?

ftshijt commented 1 year ago

Hi, thanks for your interest. Most of our contributors are in winter vacation due to the Chinese new year. Will back to you as soon as we are back. Before that, could you share your notebook with logs for us to check the issues?

ftshijt commented 1 year ago

Btw, FYI, we have merged most of the functionality of Muskits to ESPnet, where we gonna move our focus to there in the near future. We already have the SOTA VISinger in ESPnet-Muskits now.

impactcolor commented 1 year ago

Hi thanks for your response. Is there a notebook for ESPnet-Muskits? @ftshijt