probabl-ai / skore

Skore lets you "Own Your Data Science." It provides a user-friendly interface to track and visualize your modeling results, and perform evaluation of your machine learning models with scikit-learn.
https://probabl-ai.github.io/skore/
MIT License
70 stars 7 forks source link

fix(docs): Fix cross-validation example aggregation issues #698

Closed augustebaum closed 1 week ago

augustebaum commented 1 week ago

Currently cross-validation aggregation works by manipulating the contents of the keys "cross_validation" and "cross_validation_aggregated", and we assume that the user is only working on one model so that it makes sense to compare different runs in a plot.

In example 3 of the docs we first perform cross-validation on a classification model, and then later on a regression model. Because of this, the aggregation process fails and the docs cannot be built.

This is a dirty, quick fix where we delete the contents of the keys "cross_validation" and "cross_validation_aggregated" before the regression example, to start fresh.

We are already planning more robust, automatic solutions to relax the "one-model" assumption: see