search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.69k stars 655 forks source link

Scatterplots for Experiment Comparison #984

Closed pedro-sidra-isi closed 7 months ago

pedro-sidra-isi commented 1 year ago

Proposal Summary

Add a scatterplot view to the Hyperparameters section when comparing experiments: image

Chose an X-Axis from the "Hyperparameter" values and a Y-Axis from the "Scalars".

Motivation

When exploring my results, I might want to visualize the correlation between a specific hyperparameter and a specific performance metric.

Plotting an X-Y Scatterplot of Paremeter - Metric can be much easier to interpret than a parallel coordinates plot.

Related Discussion

https://clearml.slack.com/archives/CTK20V944/p1681838738290319

ainoam commented 1 year ago

Thanks for proposing @pedro-sidra-isi!

We'll take into account as we plan ClearML's next versions.

pollfly commented 7 months ago

Hey @pedro-sidra-isi! clearml-server 1.15.0 is now out, supporting scatter plot mode in experiment hyperparameter comparison.

pedro-sidra-isi commented 7 months ago

Hey @pedro-sidra-isi! clearml-server 1.15.0 is now out, supporting scatter plot mode in experiment hyperparameter comparison.

Nice, We'll be testing it out!