search

miso-belica / sumy

Module for automatic summarization of text documents and HTML pages.
https://miso-belica.github.io/sumy/
Apache License 2.0
3.51k stars 529 forks source link

How to change Rouge parameters? #120

Open jamal833 opened 5 years ago

jamal833 commented 5 years ago

In command sumy_eval random modsum/some_name.2.txt --language=english --file=docs/text.txt --format=plaintext How I can change different parameters of Rouge evaluation like -a -c 95 -b 665 -m -n 4 -w 1.2?

miso-belica commented 5 years ago

Hi @jamal833, I am afraid you can't change them. I don't know where your args -a -c 95 -b 665 -m -n 4 -w 1.2 come from but feel free to define such functionality here and maybe create PR but I am afraid that because there are many evaluation methods this would lead to really many parameters. Maybe you can use the evaluation algorithms from Python script with your own tweaks.

deepaksinghtopwal commented 3 years ago

@miso-belica How can i evaluate the quality of summary (i.e. Rouge score etc.) if i am using Sumy an Non CLI command(i.e. sumy_test.py and ren running the script)?

miso-belica commented 3 years ago

Not sure what you are asking precisely but you can see examples in https://github.com/miso-belica/sumy/blob/master/sumy/evaluation/__main__.py