search

allegroai / clearml-server

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Other
364 stars 132 forks source link

[Feature request][UI][Visualization] Allow different ways of showing reported histograms in task comparisson view #203

Open pktiuk opened 1 year ago

pktiuk commented 1 year ago

Use case example

I have dataset for which I want to generate some histograms to allow easy comparison of different versions of it.

I log some data (histogram showing classes labeled in this dataset):

l2.report_histogram(title='Liczby klas', series='classes_series',
     values=vector_series, iteration=0, labels=['A','B','C', "dog", "cat"], xaxis='Klasa', yaxis='Ilość')

And in the experiment view (Plots) I see:

image

This looks nice.

But when I want to compare this dataset with another one with the same type of histogram instead of a single histogram with multiple classes I get:

image

This view has some advantages (especially when I want to compare a lot of datasets) but it takes a lot of space and may be difficult to navigate.

Proposed solution

I would strongly prefer having all of these data in the single histogram. I think it should look like this:

image

In this case I see all of the classes, I can easily zoom to look at selected classes

I think It would be good to add some kind of toggle to switch between current (default) view and the view aggregating everything.

pktiuk commented 1 year ago

I am not sure whether it is a good repo for this request, maybe it should be moved to https://github.com/allegroai/clearml or https://github.com/allegroai/clearml-web