search

neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
359 stars 36 forks source link

Accelerate ci avoid external stats #549

Closed pfliu-nlp closed 1 year ago

pfliu-nlp commented 1 year ago

Blocked by: https://github.com/neulab/ExplainaBoard/pull/548

This PR revisits this issue https://github.com/neulab/ExplainaBoard/issues/478 (thank @tetsuok for creating this) by avoiding calculating external stats for a large file. (this is fine since it wouldn't affect the original test purpose.

by

rm -rf ~/.cache/explainaboard
time python -m unittest -v integration_tests.summarization_test.SummarizationTest

Previously:

Ran 5 tests in 438.659s
OK (skipped=2)

Now:

Ran 5 tests in 15.474s

OK (skipped=2)