Closed danieldeutsch closed 4 years ago
Successfully setting up ROUGE can sometimes require rebuilding the data files, like so:
https://github.com/danieldeutsch/sacrerouge/blob/c2147cce70d477e175acfbb94063496de3621fe8/.github/workflows/unit-test.yml#L39-L46
If the data files aren't correctly formatted, I believe ROUGE does not crash, but it will be incorrectly calculated. We should (1) detect when this happens to alert the user, and (2) potentially try to fix it ourselves by running the above comands.
Successfully setting up ROUGE can sometimes require rebuilding the data files, like so:
https://github.com/danieldeutsch/sacrerouge/blob/c2147cce70d477e175acfbb94063496de3621fe8/.github/workflows/unit-test.yml#L39-L46
If the data files aren't correctly formatted, I believe ROUGE does not crash, but it will be incorrectly calculated. We should (1) detect when this happens to alert the user, and (2) potentially try to fix it ourselves by running the above comands.