search

gkno / gkno_launcher

The gkno launcher for executing tools or pipelines
MIT License
32 stars 7 forks source link

Output filename conflicts #44

Closed AlistairNWard closed 9 years ago

AlistairNWard commented 9 years ago

It is possible that a pipeline is constructed which includes tasks that are themselves pipelines. If the contained pipelines take the same input data, they can result in the same output file names (assuming that they are built by gkno). Implement a check to ensure that the filenames are amended to avoid conflicts.

AlistairNWard commented 9 years ago

Fixed. Random text is added to all intermediate files to avoid conflicts between files. All final output files are checked for duplicates and the pipeline will not run if there are conflicts and a warning is provided. A text string can be supplied in the pipeline configuration file to allow names generated by pipeline tasks to be unique.