geodesymiami / rsmas_insar

RSMAS InSAR code
https://rsmas-insar.readthedocs.io/
GNU General Public License v3.0
59 stars 23 forks source link

job_submission as a separate repo #458

Open mirzaees opened 3 years ago

mirzaees commented 3 years ago

It would be great if we separate all the job submission scripts and defaults as an stand alone package. in that case, we can use it for every new software we use/write and it would not be limited to isce and minsar jobs Also, If I want to use only job submission modules, I would not need to have the whole minsar necessarily

what should be separated, are:

job_submission.py, submit_jobs.bash, sbatch_conditional.bash queues.cfg and a template for job_defaults.cfg to modify according to any job (with arbitrary naming not hard coded in the scripts)

falkamelung commented 3 years ago

To what I see, the first step would be to remove the write_jobs from create_runfiles.py and put it into a script runfiles_2_jobfiles.py. Is that right? I wanted to rename create_runfiles.py to create_jobfiles.py, but separating into two might make more sense.

mirzaees commented 3 years ago

Yes, I had not think about it but it would be great to do it. makes everything easier