opcode81 / sensAI

The Python library for sensible AI.
https://opcode81.github.io/sensAI/docs/
Other
40 stars 3 forks source link

Expose default eval metrics to user #76

Closed MischaPanch closed 8 months ago

MischaPanch commented 8 months ago

We use default metrics in evaluations but the user has to read source code to see them (e.g., in RegressionEvalStats).

Users might want to know which metrics are being used and also have access to their names, e.g. for operating on eval results.

We should probably just have them as global variables (in a tuple) for easy access. An alternative would be to have a property or a method get_default_metrics in the stats classes, but that would maybe be harder to find