Is there a list of stop words?

nlpyang / BertSum

Code for paper Fine-tune BERT for Extractive Summarization

Apache License 2.0

1.46k stars 422 forks source link

Closed DarlineFiedler closed 3 years ago

DarlineFiedler commented 4 years ago

Is there a list of stop words in Rouge?

How can I display the n-grams of rouge? I need it for my thesis. and does anyone know how to use a different evaluation?

tschomacker commented 4 years ago

You could use https://github.com/kavgan/ROUGE-2.0 for inlcuding a stop word list. There are a few stop word lists: http://www.lextek.com/manuals/onix/stopwords2.html (english), https://tcpip.wtf/en/deutsche-stopwords.htm (german). I think the most easy evaluation metric to use would be BLEU

DarlineFiedler commented 4 years ago

that means das ROUGE 1.5.5 don't have a stop word list?

tschomacker commented 4 years ago

there is a -s argument for using a stop word list but I could not find where the stop word list in the repository: https://github.com/andersjo/pyrouge/tree/master/tools/ROUGE-1.5.5

DarlineFiedler commented 3 years ago

Thanks