search

neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
361 stars 36 forks source link

DataLab logging is too verbose in integration tests #471

Closed neubig closed 2 years ago

neubig commented 2 years ago

Currently DataLab logs the progress of downloads, which leads to extremely large integration test logs (example). We should be able to turn this logging off, at least for tests.

Based on this and this, it seems that probably:

datalabs.utils.logging.set_verbosity(datalabs.utils.logging.NOTSET)

would turn off the progress bar for downloading.

tetsuok commented 2 years ago

I think it makes more sense to fix the logic in http_get so that we can suppress progress message when the verbosity (the log level) is severe than logging.INFO as well.

neubig commented 2 years ago

Yeah, I agree.

tetsuok commented 2 years ago

Re-run integration tests with datalabs 0.4.11, but the issue still persists: https://github.com/neulab/ExplainaBoard/runs/8293762905?check_suite_focus=true#step:5:467