search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.69k stars 655 forks source link

Dataset.list_datasets() doesn't have the option to exclude archived data #1067

Closed natephysics closed 1 year ago

natephysics commented 1 year ago

Proposal Summary

Currently, when generating a dataset list using Dataset.list_datasets() it's not possible to exclude archived data. I plan to submit a PR for the change.

Motivation

Usually failed experiments end up archived and our workflow involves examining the dataset history but we want to exclude things like archived data in that analysis. The change is pretty minimal and it provides a functionality that other users might very well need themselves.

Related Discussion

https://clearml.slack.com/archives/CTK20V944/p1688721968770759

ainoam commented 1 year ago

Thanks for proposing @natephysics. Would love to get a PR :)

natephysics commented 1 year ago

https://github.com/allegroai/clearml/pull/1069 ✔