AppraiseDev / Appraise

Appraise code used as part of WMT21 human evaluation campaign
BSD 3-Clause "New" or "Revised" License
22 stars 12 forks source link

Remove `critical` severity from MQM/ESA #138

Closed zouharvi closed 7 months ago

zouharvi commented 7 months ago

Self-explanatory. Currently there seems to be confusion when to label something as critical and removing it simplifies the protocol. The downside is even larger deviation from original MQM.

This should probably also include some color changes (not yellow but rather pink and red?).

zouharvi commented 7 months ago

Fixed in 1d8f4b6.