search

microsoft / hi-ml

HI-ML toolbox for deep learning for medical imaging and Azure integration
https://aka.ms/hi-ml
MIT License
269 stars 60 forks source link

ENH: Add support to specify input and output data names #953

Closed fepegar closed 2 months ago

fepegar commented 3 months ago

When downloading or mounting a data asset on AML, it can be given a "name" that can be used to retrieve the target folder dynamically inside the submitted job. This PR adds support to specify names, alternatively to the default INPUT_0 etc.

Before:

dataset_config = DatasetConfig(
    name=path,
    version=version,
    use_mounting=mount,
)

image

After:

dataset_config = DatasetConfig(
    name=path,
    version=version,
    use_mounting=mount,
    data_name="eval_data_dir",
)

image

The command may now include an argument ${{inputs.eval_data_dir}} which will be interpolated to the local folder where the data lives during the run.

fepegar commented 2 months ago

Thanks @samb-t and @ant0nsc for reviewing!