search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.7k stars 657 forks source link

delete dataset from minio by WebUI #1324

Closed lolpa1n closed 2 months ago

lolpa1n commented 2 months ago

Hello!, I want to delete data from minio via the webui, I was able to delete via the SDK, but via the web version they remain in minio. Is there such a function? I just don't want to delete all datasets via SDK

oren-allegro commented 2 months ago

Hi @lolpa1n ,

You should have a service called async_delete Depending on your server setup (docker-compose or K8s) - you can define the following variable in the async_delete service: CLEARML__services__storage_credentials__aws__s3__credentials=[{host:"your-minio.domain.com:443",key:"12345678",secret:"AaBbCcDd1234567890"}]

This will allow the server to also erase the minio artifacts when deleting tasks and datasets.