search

MAAP-Project / gedi-subsetter

MAAP DPS algorithm for subsetting GEDI data
Apache License 2.0
5 stars 0 forks source link

Subsetting fails when a granule file is corrupted #17

Closed chuckwondo closed 1 year ago

chuckwondo commented 1 year ago

When a granule file is corrupted, the whole subsetting job fails. For example:

OSError: Unable to open file (truncated file: eof = 1481376008, sblock->base_addr = 0, stored_eof = 1750328398)

The particular case where this was discovered was during subsetting of L2A data, and the particular corrupted file is for granule SC:GEDI02_A.002:2432546346

To handle this situation, we should simply ignore (but still log) any errors related to attempting to open a granule file, thus skipping such problematic files.

chuckwondo commented 1 year ago

Ran a successful DPS job that logged the expected warning message about the corrupt file. Job ID: a61713d0-5ce3-464c-9705-2c251e19cc2b