search

mlte-team / mlte

An infrastructure for evaluating machine learning models.
http://mlte.rtfd.io/
MIT License
9 stars 3 forks source link

Persist `Result` #122

Open turingcompl33t opened 1 year ago

turingcompl33t commented 1 year ago

We should add the ability to persist instances of Result across sessions. This makes the interface consistent with all other mlte types that support this functionality.

This capability is critical for allowing mlte to interoperate with other ML workflows. For instance, if users wish to communicate results in some manner other than the MLTE report, then the ability to load all previously-collected Result instances provides this opportunity.

turingcompl33t commented 1 year ago

Update this issue to reference Result rather than ValidationResult to reflect rename.

sebastian-echeverria commented 11 months ago

Currently this can also be done through the ValidatedSpec, though in that case all results are put together. We would still have to evaluate if we want to persist results separately. One option is to add this ability, even if it is not used in the "standard" workflow.