search

neulab / ExplainaBoard

Interpretable Evaluation for AI Systems
MIT License
361 stars 36 forks source link

Disambiguate "conf" #475

Closed odashi closed 2 years ago

odashi commented 2 years ago

This pull request attempts to remove ambiguation around "conf" in the repository. This abbreviation is used for different meanings: confidence, confusion, and config. Using full name is preferred to avoid user-side confusion.

This pull request also changes the name of arguments conf_value to confidence_alpha, and fix descriptions to avoid "p-value" wording. In principle, the confidence level (or confidence coefficient) is a constant $(1-\alpha)$ defined before any analysis, while p-value is a result produced by some statistical test. They are pointing to different concepts.

odashi commented 2 years ago

I thought confidence_alpha is much better than confidence_level because the latter makes another confusion.