Boteval / compare-classifiers

A library for juxtaposing classification performance over a given dataset
Eclipse Public License 1.0
1 stars 0 forks source link

Missing: a user-friendly mapping file validation #6

Open matanox opened 7 years ago

matanox commented 7 years ago

Validation errors over the mapping file, and about implications of a mismatch between its contents and the actual files, are only descriptive enough to one that either wrote or learned the code of this repo.

This is not good enough for letting other people tinker configuration and use the program.

A validation module (or catching errors sooner with higher-level error messages) is needed for that.

https://github.com/Boteval/nlu-eval/issues/5 is just a specific case.