search

s3prl / s3prl

Self-Supervised Speech Pre-training and Representation Learning Toolkit
https://s3prl.github.io/s3prl/
Apache License 2.0
2.16k stars 478 forks source link

What is the accept rate in the VC task evaluation output? #530

Open raotnameh opened 5 months ago

raotnameh commented 5 months ago

Mean MCD, f0RMSE, f0CORR, DDUR, CER, WER, accept rate: 7.43 37.94 0.237 0.343 3.5 8.4 94.00

For this example, the accept rate is 94. What does it mean?

Also, in the WavLM paper, the authors use EER for the VC task, how do they get it?

Lastly, why is it that in the official SUPERB benchmark public challenge, VC is not shown?

leo19941227 commented 4 months ago

Hi,

I can only answer your last question. Since the public submission is actually for the SUPERB Challenge @ SLT, where only partial tasks are selected. Here is the challenge rules.

For the prior questions, I think it is more appropriate to contact the original author of the VC task. You might want to ask him on the S3PRL-VC issue page.