search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.69k stars 655 forks source link

Can't access plot previous iterations #995

Open zylprivate opened 1 year ago

zylprivate commented 1 year ago

Describe the bug

The picture automatically changes to the first in the series when the iteration variable is adjusted. When comparing plots graphs of multiple experiments, iteration variables cannot show，but it works well in single experiement plots.

To reproduce

Eg.: There are server series figures with same title. No matter which image I adjust the iteration , it always show the first figure in series. image image

iteration variables cannot show in multiple experiments comparision: image iteration variables can show in single experiments : image

Expected behaviour

What is the expected behaviour? What should've happened but didn't?

ainoam commented 1 year ago

@zylprivate Plots comparison uses the single last iteration of each of the tasks under comparison, so you are simply describing the functionality as it was designed 🙂

What are you missing here: Visibility of which iteration is being used? The ability to control which iterations are being compared?

zylprivate commented 1 year ago

I sincerely hope to control which iterations are being compared.

ainoam commented 1 year ago

Thanks for the suggestion @zylprivate.

We'll try to add this to a future release.

zylprivate commented 1 year ago

But how to solve the first problem that no matter which image I adjust the iteration it always show the first figure in series ?

ainoam commented 1 year ago

@zylprivate The iteration selector available in the in-task single plot view affects only what you are viewing at the moment: Letting you browse through the plots logged for the task.

At this time comparison is limited to the last reported iteration from each task.

zylprivate commented 1 year ago

I mean how can I keep the platform from automatically switching to another image when I iterate over the image I'm currently viewing.

ainoam commented 1 year ago

Apologies @zylprivate I was thrown off by your emphasis of comparison.

Indeed it seems that iteration navigation only shows the latest for each metric/variant - We'll look at correcting this.

zylprivate commented 1 year ago

Thank you very much for your reply. I will describe the problem more clearly next time. Thanks again for the answers to your questions, and I'm glad to see that bugs and features can be improved and implemented.