neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
360 stars 36 forks source link

reload_stat -> use_cache #585

Closed odashi closed 1 year ago

odashi commented 1 year ago

Overview

Remove reload_stat in SysOutputInfo and --reload-stat CLI option, introduce --no-use-cache instead.

Details

reload_stat controls the behavior around the background system and not the SysOutput's interest. This change introduces use_cache option to Processor.process to handle the flag directly.

The name reload_stat is also confusing: it is unclear which True or False uses cache. Since reload_stat is a normally-on flag to "use" the cache, using the option name --no-use-cache would be more clear.

References

Blocked by