How to setup clearML Agent Services with public github as well as any proprietary git tools

allegroai / clearml-server

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

https://clear.ml/docs

Other

381 stars 132 forks source link

How to setup clearML Agent Services with public github as well as any proprietary git tools #105

Open AhmadShaik opened 2 years ago

AhmadShaik commented 2 years ago

For Linux only, configure the ClearML Agent Services. If CLEARML_HOST_IP is not provided, then ClearML Agent Services uses the external public address of the ClearML Server. If CLEARML_AGENT_GIT_USER / CLEARML_AGENT_GIT_PASS are not provided, then ClearML Agent Services can't access any private repositories for running service tasks.

export CLEARML_HOST_IP=server_host_ip_here
export CLEARML_AGENT_GIT_USER=git_username_here
export CLEARML_AGENT_GIT_PASS=git_password_here

I saw the above instructions in configuring the ClearML Agent Services. Can someone explain this with an example.

jkhenning commented 2 years ago

Hi @AhmadShaik,

CLEARML_HOST_IP is used to specify a custom IP address with which the Agent will access the server. Usually, the services agent is running alongside the server and will access the server via the internal docker network (so normally you don't need to specify a custom IP address)
CLEARML_AGENT_GIT_USER and CLEARML_AGENT_GIT_PASS are used by the agent when running a task who's Git repository requires authentications - in case your tasks contain reference to public GitHub repositories, for example, these environment variables will not be needed.