search

allegroai / clearml

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution
https://clear.ml/docs
Apache License 2.0
5.69k stars 655 forks source link

Support AWS AutoScaler mode without docker #727

Open jpmediadev opened 2 years ago

jpmediadev commented 2 years ago

performance under docker is 10% lower than on bare metal, at a fraction of the scale, this becomes a significant savings

in clearml/automation/cloud_driver.py has bash_script_template and docker support is hardcoded >>python -m clearml_agent --config-file ~/clearml.conf daemon --queue '{queue}' {docker}

docker="--docker '{}'".format(self.docker_image) if self.docker_image else ""

it would be nice to add an option to not use docker

idantene commented 2 years ago

If you don't specify a base image for the auto scaler, it doesn't use docker :)

jpmediadev commented 2 years ago

Thanks!

I thought it would use the setting from the config:

default_docker: {
    # default docker image to use when running in docker mode
    image: "nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04"