ROUGE automatic summarization evaluation toolkit. Support for ROUGE-[N, L, S, SU], stemming and stopwords in different languages, unicode text evaluation, CSV output.
I need ROUGE scores with stemming applied on summaries.
I can get the scores with default settings. But, when I change the 'rouge.properties' and set the stemmer to true (stemmer.use=true), the following exceptions are caught:
$ java -jar rouge2-1.2.1.jar
2019-06-03 15:43:07 INFO SettingsUtil:33 - Using rouge.properties='/data/azs5955/ppt_generation/rouge/java/rouge.properties'
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=L
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=1
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=2
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=SU4
2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1129 ngram=L
2019-06-03 15:43:07 ERROR ROUGECalculator:180 - 0
2019-06-03 15:43:07 ERROR ROUGECalculator:181 -
You need to have a valid 'references' and 'system' folder under projects/test-summarization. Please check your rouge.properties file
2019-06-03 15:43:07 ERROR ROUGECalculator:183 - 0
java.lang.ArrayIndexOutOfBoundsException: 0
at com.rxnlp.tools.rouge.ROUGECalculator.applyStemming(ROUGECalculator.java:735)
at com.rxnlp.tools.rouge.ROUGECalculator.computeRouge(ROUGECalculator.java:503)
at com.rxnlp.tools.rouge.ROUGECalculator.evaluate(ROUGECalculator.java:213)
at com.rxnlp.tools.rouge.ROUGECalculator.start(ROUGECalculator.java:172)
at com.rxnlp.tools.rouge.ROUGECalculator.main(ROUGECalculator.java:96)
I need ROUGE scores with stemming applied on summaries. I can get the scores with default settings. But, when I change the 'rouge.properties' and set the stemmer to true (stemmer.use=true), the following exceptions are caught:
$ java -jar rouge2-1.2.1.jar 2019-06-03 15:43:07 INFO SettingsUtil:33 - Using rouge.properties='/data/azs5955/ppt_generation/rouge/java/rouge.properties' 2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=L 2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=1 2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=2 2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1008 ngram=SU4 2019-06-03 15:43:07 INFO ROUGECalculator:203 - Working on task1129 ngram=L 2019-06-03 15:43:07 ERROR ROUGECalculator:180 - 0 2019-06-03 15:43:07 ERROR ROUGECalculator:181 - You need to have a valid 'references' and 'system' folder under projects/test-summarization. Please check your rouge.properties file 2019-06-03 15:43:07 ERROR ROUGECalculator:183 - 0 java.lang.ArrayIndexOutOfBoundsException: 0 at com.rxnlp.tools.rouge.ROUGECalculator.applyStemming(ROUGECalculator.java:735) at com.rxnlp.tools.rouge.ROUGECalculator.computeRouge(ROUGECalculator.java:503) at com.rxnlp.tools.rouge.ROUGECalculator.evaluate(ROUGECalculator.java:213) at com.rxnlp.tools.rouge.ROUGECalculator.start(ROUGECalculator.java:172) at com.rxnlp.tools.rouge.ROUGECalculator.main(ROUGECalculator.java:96)
any suggestion is appreciated.