ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
Added the option include_archived to Dataset.list_datasets() class method which, if False, will exclude archived datasets from the list. Defaults to True to maintain the current behavior of the class method. While it's possible to filter datasets using the get() class method it wasn't possible to do the same for the list_datasets() method. This feature seems useful to include and it's a simple, non-breaking modification.
Updated formatting (whitespaces/spaces after comma/line breaks) in accordance with the flake8 formatting checks for dataset.py. As suggested in the contribution guidelines, fake8 was used to validate the formatting. Several errors were found from prior commits that were fixed.
Testing Instructions
Dataset.list_datasets(..., include_archived=False) shouldn't include archived datasets in the list.
Related Issue \ discussion
Related issue: https://github.com/allegroai/clearml/issues/1067
Patch Description
Added the option include_archived to Dataset.list_datasets() class method which, if False, will exclude archived datasets from the list. Defaults to True to maintain the current behavior of the class method. While it's possible to filter datasets using the get() class method it wasn't possible to do the same for the list_datasets() method. This feature seems useful to include and it's a simple, non-breaking modification.
Updated formatting (whitespaces/spaces after comma/line breaks) in accordance with the flake8 formatting checks for dataset.py. As suggested in the contribution guidelines, fake8 was used to validate the formatting. Several errors were found from prior commits that were fixed.
Testing Instructions
Dataset.list_datasets(..., include_archived=False) shouldn't include archived datasets in the list.