Closed minhptx closed 4 years ago
run
{PARAMS}
{INPUTS}
{OUTPUTS}
Set enviroment variable DATA_CATALOG_DOWNLOAD_DIR, where the data will be downloaded.
DATA_CATALOG_DOWNLOAD_DIR
Start docker container docker run --rm -p 5000:5000 -v $(pwd):/ws -v /tmp:/tmp -w /ws -it --entrypoint=/bin/bash mint_dt
docker run --rm -p 5000:5000 -v $(pwd):/ws -v /tmp:/tmp -w /ws -it --entrypoint=/bin/bash mint_dt
Run the run script using the following command
./run --config [config_path] -i1 [dataset_id1] -i2 [dataset_id2] ... -p1 [param1] -p2 [param2] ... -o1 [output_file1]
templates
filled
scripts
Change log:
runscript that should work for all transformation pipelines (probably with small changes){PARAMS},{INPUTS},{OUTPUTS}in the YAML template files.Instructions:
Set enviroment variable
DATA_CATALOG_DOWNLOAD_DIR, where the data will be downloaded.Start docker container
docker run --rm -p 5000:5000 -v $(pwd):/ws -v /tmp:/tmp -w /ws -it --entrypoint=/bin/bash mint_dtRun the
runscript using the following command{PARAMS},{INPUTS},{OUTPUTS}keywords in YAML files.templatesfolder: template YAML filesfilledfolder: YAML files with parameters filled inscriptsfolder: scripts with all parameters specified for testing