Fix tar files - Githubissues

TerraFusion / basicFusion

Terra Basic Fusion Project - University of Illinois

Other

2 stars 0 forks source link

Fix tar files #309

Closed LandonTClipp closed 6 years ago

LandonTClipp commented 6 years ago

[x] 40422 Has GMP files included twice. Fix transferred to Nearline (March 5 2018).
[x] 37408 Identified MISRAA file as corrupt. Removed file from tar. Fix transferred to Nearline (March 5 2018)_
[x] 21232 Identified MISR_AM1_GRP_ELLIPSOID_GM_P175_O021232_BF_F030024.hdf as corrupt. Fix transferred to Nearline (March 5 2018)_
[x] 33889 Identified MOD02QKM.A2006122.1210.006.2014228111426.hdf as corrupt. Removed file from tar. Transferred to Nearline (March 6 2018).
[x] 13659 Queried SQLite DB for correct files from Condo. Pulled from condo, manually generated tar (same structure as all others). Transferred to Nearline (March 6 2018).
[x] 13660. MISR_PATH file was simply never created. Manually created MISRPATH and re-tarred all Terra files. Transferred to Nearline (March 8 2018)_

kyang2014 commented 6 years ago

The MODIS file at 33889 was re-downloaded after you transferred the original corrupt one to nearline. So don't remove that file and changed the tar file. Just transfer this file from condo to nearline.

LandonTClipp commented 6 years ago

I redownloaded the file from condo, retarred and sent back to Nearline. Hopefully now this is correct.

kyang2014 commented 6 years ago

The inputfile at 37408 is not fixed. The corrupt AA file is still listed there.

LandonTClipp commented 6 years ago

I will try to fix this in a few minutes. Not sure why that is still there.

LandonTClipp commented 6 years ago

The file was accidentally misnamed when I initially transferred it. Used same mispelling when I initially verified file. I pushed back the correct name and confirmed it to be correct.

LandonTClipp commented 6 years ago

Orbit 13659 does not seem to be on Nearline. Have you re-processed this one?

kyang2014 commented 6 years ago

13659 as well other 5 troubled orbits were reprocessed.

Check them under /u/sciteam/ymuqun/scratch/bf_workflow/BFoutput

On Mar 15, 2018, at 11:19 AM, Landon Clipp notifications@github.com<mailto:notifications@github.com> wrote:

Orbit 13659 does not seem to be on Nearline. Have you re-processed this one?

— You are receiving this because you commented. Reply to this email directly, view it on GitHubhttps://github.com/TerraFusion/basicFusion/issues/309#issuecomment-373435321, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AJyiE7zfv3uIn295HomLW5pl1d1QLkLtks5tepSpgaJpZM4SeETA.