ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
I am new in clearml and I can not get the dataset from the server.
It is the same when i use SDK
There is no issue for my colleagues, but it does not work in my WSL environment.
I guess that might be the issue with my terminal / font
To reproduce
Exact steps to reproduce the bug. Provide example code if possible.
from clearml import Dataset
dataset_path = Dataset.get(
dataset_id="cbe55e59413c4149a08e3b5e7e546165"
)
---------------------------------------------------------------------------
ValueError Traceback (most recent call last)
Untitled-1.ipynb Cell 1 line 6
[2](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=1) dataset_project = "NASH"
[4](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=3) from clearml import Dataset
----> [6](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=5) dataset_path = Dataset.get(
[7](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=6) dataset_id="cbe55e59413c4149a08e3b5e7e546165"
[8](vscode-notebook-cell:Untitled-1.ipynb?jupyter-notebook#W0sdW50aXRsZWQ%3D?line=7) )
File [~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778), in Dataset.get(cls, dataset_id, dataset_project, dataset_name, dataset_tags, only_completed, only_published, include_archived, auto_create, writable_copy, dataset_version, alias, overridable, shallow_search, **kwargs)
[1774](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1774) instance = Dataset.create(
[1775](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1775) dataset_name=dataset_name, dataset_project=dataset_project, dataset_tags=dataset_tags
[1776](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1776) )
[1777](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1777) return finish_dataset_get(instance, instance._id)
-> [1778](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1778) instance = get_instance(dataset_id)
[1779](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1779) # Now we have the requested dataset, but if we want a mutable copy instead, we create a new dataset with the
[1780](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1780) # current one as its parent. So one can add files to it and finalize as a new version.
[1781](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1781) if writable_copy:
File [~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682), in Dataset.get.<locals>.get_instance(dataset_id_)
[1680](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1680) force_download = False if task.status in ("stopped", "published", "closed", "completed") else True
[1681](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1681) if cls.__state_entry_name in task.artifacts:
-> [1682](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1682) local_state_file = StorageManager.get_local_copy(
[1683](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1683) remote_url=task.artifacts[cls.__state_entry_name].url,
[1684](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/datasets/dataset.py:1684) cache_context=cls.__cache_context,
...
---> [60](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:60) raise ValueError("Expecting a list of configurations dictionaries")
[61](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:61) configs = [cls(**entry) for entry in dict_list]
[62](https://vscode-remote+wsl-002bubuntu-002d20-002e04.vscode-resource.vscode-cdn.net/home/wpan/project/tg-nash-ml-poc/~/project/tg-nash-ml-poc/.venv/lib/python3.10/site-packages/clearml/backend_config/bucket_config.py:62) valid_configs = [conf for conf in configs if conf.is_valid()]
ValueError: Expecting a list of configurations dictionaries
Expected behaviour
What is the expected behaviour? What should've happened but didn't?
Environment
Server type (self hosted \ app.clear.ml)
ClearML SDK Version 1.13.2
ClearML Server Version (Only for self hosted). Can be found on the bottom right corner of the settings screen.
WebApp: 1.12.1-397 • Server: 1.12.1-397 • API: 2.26
Python Version 3.10.13
OS (Windows \ Linux \ Macos) WSL2
Related Discussion
If this continues a slack thread, please provide a link to the original slack thread.
Describe the bug
I am new in clearml and I can not get the dataset from the server. It is the same when i use SDK
There is no issue for my colleagues, but it does not work in my WSL environment. I guess that might be the issue with my terminal / font
To reproduce
Exact steps to reproduce the bug. Provide example code if possible.
Expected behaviour
What is the expected behaviour? What should've happened but didn't?
Environment
Related Discussion
If this continues a slack thread, please provide a link to the original slack thread.