Provide info on experiment/project metric storage usage in the web UI

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

https://clear.ml/docs

Apache License 2.0

5.61k stars 651 forks source link

Provide info on experiment/project metric storage usage in the web UI #1050

Open ColeMilesKodiak opened 1 year ago

ColeMilesKodiak commented 1 year ago

Proposal Summary

In the web UI, provide info on metric storage usage both at a project level as well as an individual experiment level. It is currently impossible to figure out what experiments are responsible for using up metric storage.

Motivation

When reaching metric storage limits, it's not clear which projects are using the most storage and should be prioritized for cleaning up. When developing new debug metric plots, it's not clear how much storage is going to be used up by its use.

ainoam commented 1 year ago

Thanks for suggesting @ColeMilesKodiak.

This is indeed on our roadmap, albeit not a near term item.

d13g0 commented 1 year ago

This would be very useful! +1 👍🏼