Is your feature request related to a problem? Please describe.
Currently the main scripts chunk the files and submit jobs for each individual file. This increases the load on the server, and decreases your fair usage quotum.
Describe the solution you'd like
The individual submission scripts should be wrapped in an array job to reduce the load on the server.
Describe alternatives you've considered
An alternative would be not to chunk the files, but this would be inefficient and significantly reduce the amount of time needed to run an analysis.
Is your feature request related to a problem? Please describe. Currently the main scripts chunk the files and submit jobs for each individual file. This increases the load on the server, and decreases your fair usage quotum.
Describe the solution you'd like The individual submission scripts should be wrapped in an array job to reduce the load on the server.
Describe alternatives you've considered An alternative would be not to chunk the files, but this would be inefficient and significantly reduce the amount of time needed to run an analysis.
Additional context None.