hipe-eval / HIPE-scorer

A python module for evaluating NERC and NEL system performances as defined in the HIPE shared tasks (formerly CLEF-HIPE-2020-scorer).
https://hipe-eval.github.io
MIT License
13 stars 4 forks source link

enforce submission requirements #5

Closed aflueckiger closed 4 years ago

aflueckiger commented 4 years ago

Check the submission files of participants before evaluating.

Rules for system response files:

aflueckiger commented 4 years ago

@e-maud @mromanello Implemented with https://github.com/impresso/CLEF-HIPE-2020-scorer/commit/1bfa3968e7d8d90081be567bc5c2d6d0bffa1be3