sustainable-computing-io / kepler-model-server

Model Server for Kepler
Apache License 2.0
23 stars 25 forks source link

Evaluation Library for the Kepler Model Server #110

Open KaiyiLiu1234 opened 1 year ago

KaiyiLiu1234 commented 1 year ago

What would you like to be added?

Incorporate a standardized way of evaluating specifically Regression Sklearn (if not other models) Models and calculating essential error metrics like Mean Absolute Percentage Error and R2.

Why is this needed?

We need a better way of discussing how good our models are during tech conferences. This library will make it so new models implemented do not need to worry about including Evaluation metrics.

sunya-ch commented 5 months ago

WIP: https://github.com/sthaha/kepler-model-validation/tree/main