search

facebookresearch / seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation
Other
10.5k stars 1.02k forks source link

Cannot finetune TEXT_TO_SPEECH and SPEECH_TO_SPEECH #477

Open yiyibooks opened 1 week ago

yiyibooks commented 1 week ago

Dears,

I can finetune with m4t_finetune in SPEECH_TO_TEXT mode successfullty. However, when I finetune in --mode TEXT_TO_SPEECH and SPEECH_TO_SPEECH, the script will throw error "NotImplementedError: T2U finetuning implemented only for UnitYT2UModel".

Could someone help explain how to solve this issue to finetune TEXT_TO_SPEECH and SPEECH_TO_SPEECH?

Thank you very much!

developeranalyser commented 1 week ago

Dears,

I can finetune with m4t_finetune in SPEECH_TO_TEXT mode successfullty. However, when I finetune in --mode TEXT_TO_SPEECH and SPEECH_TO_SPEECH, the script will throw error "NotImplementedError: T2U finetuning implemented only for UnitYT2UModel".

Could someone help explain how to solve this issue to finetune TEXT_TO_SPEECH and SPEECH_TO_SPEECH?

Thank you very much!

من چند ماه درگیر این موضوع هستم و هنوز به نتیجه ای نرسیدم شما باید از مدل V1 large استفاده کنید