automl / amltk

A build-it-yourself AutoML Framework
https://automl.github.io/amltk/
BSD 3-Clause "New" or "Revised" License
68 stars 6 forks source link

[Feat] Tagging in `History` #228

Closed eddiebergman closed 9 months ago

eddiebergman commented 10 months ago

Is your feature request related to a problem? Please describe. Within the same run, we might want to concatenate different histories which are operating on different tasks, yet the reports and history dataframe will have no way to distinguish this. This means that users will have to manually add tags to the dataframe exported from histories, before they can be merged.

Describe the solution you'd like In the constructor, it could be useful to add History(tags=[dataset_name, experiment_name, ...]). It might also be useful to add tags to individual reports during add(report, tags=[...])

Describe alternatives you've considered Just manually adding tags post loop.

Additional context This could make plotting between multiple histories easier as it gives a target for automated plotting to groupby()

eddiebergman commented 9 months ago

I tried playing around with this and plotting but it seems like we would have to make a large amount of assumptions.

I'm not against tagging or plotting but it will likely take very low priority for the near future. Closing until someone other than me wants it.