tjturnage / pyart-nexrad

Pyart sandbox
0 stars 1 forks source link

Account for wider variety of filenames in AWS inventory #15

Closed ericlenning closed 4 years ago

ericlenning commented 4 years ago

The NEXRAD filename format in AWS is not the same over time. KAKQ20200404_000829_V06 KLOT20150409_235952_V06.gz KLNX20000510_000249.gz KAMX20100505_014555_V03.gz etc.

There are also non-Level2 files present: KAKQ20200404_005204_V06_MDM NWS_NEXRAD_NXL2DP_KLOT_20150409000000_20150409005959.tar

The download and plotting routines must account for these variations and not make incorrect assumptions about the length or format of a filename. The one constant about Level 2 filenames is that the first four letters are the site ID, the next eight are YYYYMMDD, and the next seven are _hhmmss. So the first 19 are consistent over time.

Exclude 'MDM' files from listing of Level 2 files. Reference filename information only from first 19 characters, not an offset from end of the filename.