geodesymiami / rsmas_insar

RSMAS InSAR code
https://rsmas-insar.readthedocs.io/
GNU General Public License v3.0
58 stars 22 forks source link

Would `nohup` avoid minsarApp.bash hangup? #494

Open falkamelung opened 3 years ago

falkamelung commented 3 years ago

I started these commands on the login shell:

minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk30SenDT106.template --start dem --sleep 0 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk31SenDT106.template --start dem --sleep 180 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk32SenDT106.template --start dem --sleep 360 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk33SenDT106.template --start dem --sleep 540 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk34SenDT106.template --start dem --sleep 720 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk35SenDT106.template --start dem --sleep 900 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk36SenDT106.template --start dem --sleep 1080 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk37SenDT106.template --start dem --sleep 1260 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk38SenDT106.template --start dem --sleep 1440 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk39SenDT106.template --start dem --sleep 1620 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk40SenDT106.template --start dem --sleep 1800 &
minsarApp.bash $SCRATCHDIR/KokoxiliBigSenDT106/chunk_templates/KokoxiliChunk41SenDT106.template --start dem --sleep 1980 &

None of them finished because of hangup:

KokoxiliChunk37SenDT106, run_02_unpack_secondary_slc, 4 jobs : 3 COMPLETED , 0 RUNNING , 1 PENDING , 0 WAITING   .
/home1/05861/tg851601/code/rsmas_insar/minsar/submit_jobs.bash: line 1: 396704 Hangup                  tail -f $logfile_name
/home1/05861/tg851601/code/rsmas_insar/minsar/submit_jobs.bash: line 1: 161369 Hangup                  sleep $wait_time
KokoxiliChunk38SenDT106, run_01_unpack_topo_reference, 1 jobs : 0 COMPLETED , 0 RUNNING , 1 PENDING , 0 WAITING   .
/home1/05861/tg851601/code/rsmas_insar/minsar/submit_jobs.bash: line 1: 402549 Hangup                  tail -f $logfile_name
/home1/05861/tg851601/code/rsmas_insar/minsar/submit_jobs.bash: line 1: 161900 Hangup                  sleep $wait_time

Would nohup avoid this?