RETURN-project / makeDataCube

Data management
Apache License 2.0
0 stars 0 forks source link

Download using FORCE throws error #25

Closed wandadk closed 3 years ago

wandadk commented 3 years ago

The download of Landsat data from Google Cloud using FORCE throws an error from time to `time. For example:

[Errno 2] No such file or directory: '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/README.GTF_.gstmp' -> '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/README.GTF'
[Errno 2] No such file or directory: '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_VER.txt_.gstmp' -> '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_VER.txt'
[Errno 2] No such file or directory: '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B3.TIF_.gstmp' -> '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B3.TIF'
[Errno 2] No such file or directory: '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B1.TIF_.gstmp' -> '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B1.TIF'
[Errno 2] No such file or directory: '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B5.TIF_.gstmp' -> '/project/return/Data/UpscaleRecovery/force/level1/223061/LT05_L1TP_223061_20040515_20161201_01_T1/LT05_L1TP_223061_20040515_20161201_01_T1_B5.TIF'
CommandException: 6 files/objects could not be transferred.

This error causes job submitted to SPIDER to stop and quit. After restarting the job, the error for this particular file was not thrown anymore.

wandadk commented 3 years ago

@PabRod : This issue is linked to issue #23