How to calculate the relavent error rate in diarization overlap?

pyannote / pyannote-metrics

A toolkit for reproducible evaluation, diagnostic, and error analysis of speaker diarization systems

http://pyannote.github.io/pyannote-metrics

MIT License

183 stars 30 forks source link

How to calculate the relavent error rate in diarization overlap? #65

Open axuan731 opened 1 year ago

axuan731 commented 1 year ago

I have a ref rttm file and a sys rttm file, I want to compute the FA = false alarm rate (%) / Miss. = missed detection rate (%) / F1 = F1-score (%) in the paper "End-to-end speaker segmentation for overlap-aware resegmentation".But I cant find the place to evaluate them in pyannote2.0 Thanks for helping!

hbredin commented 1 year ago

pyannote-metrics has some code to do that.

https://github.com/pyannote/pyannote-metrics/blob/2733ef55eed2a30e1ce2c76d935f495128a693de/pyannote/metrics/cli.py#L137-L159

http://pyannote.github.io/pyannote-metrics/reference.html#pyannote.metrics.detection.DetectionPrecisionRecallFMeasure