SelfExplainML / PiML-Toolbox

PiML (Python Interpretable Machine Learning) toolbox for model development & diagnostics
https://selfexplainml.github.io/PiML-Toolbox
Apache License 2.0
912 stars 109 forks source link

What does the back end run on? #20

Closed xloffree closed 1 year ago

xloffree commented 1 year ago

I know that this project is not currently open source, but would it be possible to know what packages the backend uses? Do you use scikit-learn to calculate most of the interpretability measurements? This would be useful to know because it tells us exactly how these metrics are calculated. For example, permutation feature importance can be calculated in multiple different ways. One can permute the observations of each feature n times, or one can swap the observations of one feature with those of another. Also, there are several different metrics one can use to quantify permutation feature importance (R2, MSE, or RMSE for regression models and accuracy, precision, etc. for classification models).

Thank you

ZebinYang commented 1 year ago

Hi, @xloffree

You are right.

All the post-hoc explanations metrics are based on external tools or packages.

While most of the intrinsic interpretability and model diagnostics are calculated by our own internal functions.