search

asvspoof-challenge / 2021

ASVspoof 2021 Baseline Systems
208 stars 75 forks source link

Where to download PA_cm_protocols #17

Closed GolferChen closed 1 year ago

GolferChen commented 1 year ago

Hello, thanks for the code. I am running the baseline of PA. The evaluation requires a file named "ASVspoof2021_PA_cm_protocols/ASVspoof2021.PA.cm.eval.trl.txt", but I cannot find it anywhere. Has it been released and where should I access it? Thanks a lot.

GolferChen commented 1 year ago

The data downloaded in https://zenodo.org/record/4834716#.Y93NOXBByUl only contains the flac files.

TonyWangX commented 1 year ago

Hi @GolferChen The package on zendo only contains flac files when it was released during the challenge.

The label file was released later after the challenge. I think the one required by the code is the stage-1 key file: LA, PA, DF. They are hosted on https://www.asvspoof.org/index2021.html (I am not handling the this part, but I may be wrong. Hi @TakHemlata, do you know who was working on this?)

Note that the label set with full meta-information and the code to evaluate pooled and decomposed EER and min-tDCF are here. Check https://github.com/asvspoof-challenge/2021/blob/aae41bb3f4f38795ebf6901c7bbf3461e4ad662b/README.md

GolferChen commented 1 year ago

Hi, @TonyWangX, thanks for the reply. You are right. Only the stage-1 key file is needed. I have successfully evaluated the performance of baselines. Thanks again.