Confusion about the calculation of DER

hitachi-speech / EEND

End-to-End Neural Diarization

MIT License

360 stars 57 forks source link

Confusion about the calculation of DER #10

Closed 875441459 closed 3 years ago

875441459 commented 3 years ago

In general, diarization tasks tolerate 250ms diar-error at the start and the end of each segment, but the function "calc_diarization_error()" in "model.py" seems do not take it into account. Did I miss something that concerns the "tolerance principle"?

shota-horiguchi commented 3 years ago

calc_diarization_error() is a function to monitor DERs during training, and as you mentioned it doesn't consider the collar torelance. Our final evaluation is conducted, e.g., here, which allows 250 ms of collar torelance.

875441459 commented 3 years ago

OK, I got it. Thank you~