Snakemake-Profiles / lsf

Snakemake profile for running jobs on an LSF cluster
MIT License
36 stars 23 forks source link

Avoid reading whole log file into memory #8

Closed mbhall88 closed 4 years ago

mbhall88 commented 4 years ago

In the case where we are unable to get the job status from LSF, we resort to checking the log file for completion status. However, the current process reads the entire log file into memory. This can become problematic if the log file is very large (which can happen depending on the program being run).

This PR uses tail to get the LSF job summary from the bottom of the file.