search

Danield21 / Rationale4CDECR

MIT License
1 stars 0 forks source link

something about evaluation results #3

Closed eeehco closed 3 months ago

eeehco commented 3 months ago

May I ask if F1 in the evaluation results refers to CoNLL F1： image

eeehco commented 3 months ago

May I ask if F1 in the evaluation results refers to CoNLL F1： image

It seems to refer to B3. How can I use CoNLL's official evaluation script to evaluate other indicators, such as muc. How can I obtain the CoNLL official evaluation script, which requires a model predicted co index chain and a real co index chain?

eeehco commented 3 months ago

May I ask if F1 in the evaluation results refers to CoNLL F1： image

It seems to refer to B3. How can I use CoNLL's official evaluation script to evaluate other indicators, such as muc. How can I obtain the CoNLL official evaluation script, which requires a model predicted co index chain and a real co index chain?

I need to calculate the F1 value of Conll, including the F1 values of MUC, B3, and CEAFE. Can you tell me how to calculate it？

Danield21 commented 3 months ago

You can refer to https://github.com/Danield21/Rationale4CDECR/blob/main/conll_eval/coreference_eval.ipynb

eeehco commented 3 months ago

You can refer to https://github.com/Danield21/Rationale4CDECR/blob/main/conll_eval/coreference_eval.ipynb

Thanks! It worked.