search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.43k stars 643 forks source link

Save hidden/visible scalars layout in "Compare Experiments" tab #1242

Closed lobanov-m closed 2 months ago

lobanov-m commented 2 months ago

Hello! Thank you for the great tool!

Proposal Summary

It would be cool if we could save a layout of the hidden and visible scalars in the "Compare Experiments" tab. And maybe reorder scalars graphs.

Motivation

I am logging many scalars during validation (separate metrics and sub-metrics (like TP, FP, FN) for every class, for every sub-task). And I use "Compare experiments" tab to see if my new experiment is better than the previous one. I look at many graphs, not the single metric, so every time i close the window I need to deselect all scalars and find the needed ones.

Probably, it could be done with "Reports", but as far as I understand, I need to paste model id in every graph by hands every time I want to see the graphs of the new experiment

Thank you!

ainoam commented 2 months ago

Thanks for suggesting @lobanov-m.

For maintaining plot comparison have you considered the experiment table comparison view? The metric selection for each project is retained.

lobanov-m commented 2 months ago

Oh, did not find that at first! Thank you very much, I will try! Looks like it is what I wanted.