neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
360 stars 36 forks source link

merge custom features/analyses from dataset and system output file #602

Closed lyuyangh closed 1 year ago

lyuyangh commented 1 year ago

Overview

custom_features and custom_analyses can come from both the dataset and the user (system output file). This PR updates FileLoaderMetadata.merge() so user-defined custom features/analyses don't override the ones defined for the datasets.

Details

References

Blocked by