Open shir22 opened 2 years ago
Elaboration on task: Suggested checks should be checks that use explainability to test some property of the model or data. They should either have a clear condition on the "OK" and "Not OK" situation, or at least have a display that clearly indicates if the current state is "OK".
Example for potentially good idea - use the diff of some FI metric between train and test to find drift Example for not-so-good idea - display SHAP beeswarm plot as is
DoD: Present overview of top relevant directions (based on existing research, trends and solutions). Suggest 3-5 explainability checks for the package.