search

grammarly / gector

Official implementation of the papers "GECToR – Grammatical Error Correction: Tag, Not Rewrite" (BEA-20) and "Text Simplification by Tagging" (BEA-21)
Apache License 2.0
891 stars 216 forks source link

how to do evaluation ? #162

Closed yuimo closed 2 years ago

yuimo commented 2 years ago

hi, i have a source and target files. and how can i do evaluation to get the m2 score?

thanks very much!

skurzhanskyi commented 2 years ago

Hi @yuimo For this, you need to prepare what is called "m2 file" first, which will contain golden rewrites (with references). I would recommend reaching out to the authors of the M2 scorer repository.