search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.61k stars 651 forks source link

Does clearml support offline import? #1133

Open yaoshanliang opened 11 months ago

yaoshanliang commented 11 months ago

Our server can't connect to an external network, but there is still a need to use clearml to analyze training. So does clearml support to generate an offline file so that I can import the file to a device that can be connected to the internet and then import it to the clearml platform.

ainoam commented 11 months ago

Yes, it does @yaoshanliang. See https://clear.ml/docs/latest/docs/clearml_sdk/task_sdk#offline-mode.

yaoshanliang commented 11 months ago

@ainoam Thank you. I have generated the offline zip file. When I upload this file, it outputs 'INFO - Failed model upload' as the path on the external network is different from that on my computer. How can I disable the model upload or make a relative path in the zip file.

ainoam commented 11 months ago

@yaoshanliang the ClearML storage handler supports path substition for such use cases: Configuring registered_prefix to match your original path and local_prefix to the desired one, before import_offline_session() is called should upload to the desired location.