Given a Pyramid and a PyramidAnnotation, calculate the modified pyramid score. It will almost definitely be different than what is reported in DUC and TAC because the pyramid files often had errors, so our pyramids are very slightly different than what was used in the original calculations.
We should also include experiments that show the correlation to the original score as well as the responsiveness.
Given a
Pyramid
and aPyramidAnnotation
, calculate the modified pyramid score. It will almost definitely be different than what is reported in DUC and TAC because the pyramid files often had errors, so our pyramids are very slightly different than what was used in the original calculations.We should also include experiments that show the correlation to the original score as well as the responsiveness.