How to run a bash script instead of a Python script in clearml-agent?

[konstantinator]

I've noticed that with clearml, I can only run Python scripts, which is not very convenient for me. I would like to run Python scripts through bash using accelerate (for training on multiple GPUs). Currently, I have to launch the bash script through Python code, like this:

import os
os.system('./hello.sh')

The sh script (hello.sh) itself looks something like this:

CUDA_VISIBLE_DEVICES=0,1 \
accelerate launch --config_file config.yaml hello.py --arg_1 2 --arg_2 file.csv

This solution seems like a workaround. Is there a more proper approach?

[jkhenning]

Hi @konstantinator , thanks for the input! This is currently the way to do that. We'll add an option to run bash scripts in future versions :)