Details on TTS evaluation?

Btlmd commented 1 month ago

Hello! Thanks for your wonderful work. Trying to reproduce your results on the TTS task, I'm wondering if you could provide more details about the evaluation of the TTS task, especially:

How many / Which samples are used in VCTK dataset
Which ASR model is used to convert the generated speech into text
How the WER is calculated; What kind of text normalization is applied before the calculation

Thanks!

JunZhan2000 commented 1 month ago

Please refer to Appendix C.

jee019 commented 4 weeks ago

Hi, I have a few questions about zero-shot TTS evaluation using the VCTK dataset.

1. Evaluation Methodology:

We randomly select a 3-second clip from each speaker as the vocal prompt along with a separate text as input.

In the paper, particularly in Appendix C, the evaluation process seems a bit open to interpretation. Could you please provide a detailed description of how the evaluation was conducted? Additionally, did you use all audio files from the VCTK dataset for the evaluation and cut off any entries longer than 3 seconds?

2. Dataset Usage: I am curious about the specific version of the VCTK dataset used in your study. Did you only utilize audio files from the "mic2" recordings in the VCTK 0.92 version?

OpenMOSS / AnyGPT

Details on TTS evaluation? #42