pltrdy / files2rouge

Calculating ROUGE score between two files (line-by-line)
MIT License
191 stars 53 forks source link

Problem with stemming #34

Closed moussaKam closed 4 years ago

moussaKam commented 4 years ago

Hi, I am trying to perform the stemming before computing the statistics. I added -m option in the args however I'm getting the same scores as without it.

jxhe commented 4 years ago

That's because pyrouge sets stemming as True by default, but files2rouge updates this with https://github.com/pltrdy/files2rouge/commit/e39d882f489a56c8cf80511f8610636d6bbb5d36, you can try installing the latest files2rouge to obtain non-stemming results.