search

geodesymiami / rsmas_insar

RSMAS InSAR code
https://rsmas-insar.readthedocs.io/
GNU General Public License v3.0
58 stars 22 forks source link

stripmapstack: unreproducible copy_to_tmp.bash error from run_07_* #502

Open falkamelung opened 2 years ago

falkamelung commented 2 years ago

I got an error for run_07_* to run out of disk space in the copy_to_tmp.bash step. It did not get the first date right and instead copied the entire SLC_crop. Later when I ran again it worked fine and copied rightly 20210113

Bad one:

 grep crop run_07*_0_8*.o
Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/ to /tmp
/scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/ has been copied to /tmp/ on each compute node.
Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210214 to /tmp
/scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210214 has been copied to /tmp/20210214 on each compute node.
Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210302 to /tmp
/scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210302 has been copied to /tmp/20210302 on each compute node.

Good one:

Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210113 to /tmp
run_07_fineResamp_0_8507552.o:/scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210113 has been copied to /tmp/20210113 on each compute node.
Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210214 to /tmp
/scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210214 has been copied to /tmp/20210214 on each compute node.
Going to distribute directory /scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210302 to /tmp
scratch/05861/tg851601/MaunaLoaCskAT10/SLC_crop/20210302 has been copied to /tmp/20210302 on each compute node.