allegroai / clearml-server

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Other
364 stars 132 forks source link

Single values reported in task not visible in graph mode (comparing tasks) #202

Open pktiuk opened 1 year ago

pktiuk commented 1 year ago

Example usecase

I create a dataset and I want to have some simple metrics for comparing them (like total number of images, number of objects detected etc), co after creating dataset I report some single values

dataset.get_logger().report_single_value("number of images",images_num)

After creating some datasets in this convention I want to easily compare them by looking at plots and I see this:

image

I have to switch to other views like min values to see my value in Summary

image

Solution

Just generate a simple bar plot showing single values for different compared versions of my dataset

Desired solution:
image

ainoam commented 1 year ago

Thanks for suggesting @pktiuk.

Adding a bar chart visualization is indeed on our roadmap.

pktiuk commented 1 year ago

Is your roadmap publicly available somewhere?

ainoam commented 1 year ago

While we don't have a publicly available roadmap at this time, we encourage users join the conversation both here and in the ClearML slack space to influence and get updates on our progress, upcoming features, and important announcements.

pollfly commented 7 months ago

Hey @pktiuk! v1.13.0 is now out, supporting a visual comparison of single value scalars.