Marie Kondo'ing the bucket

leothomas commented 3 years ago

Detections sub-folders should follow the convention: detections-<type> (eg: detections-plane).

[ ] Copy all (new) data from detection-contrails/ to detections-contrail/
[ ] rename detections-vehicles/ to detections-vehicle/
[ ] remove wq-greatlakes-sm/ and wq-greatlakes-chl/ (these were renamed to wq-gl-spm/ and wq-gl-chl/ respectively (the spotlight id gl is necessary for the dates to pass the filtering, since the filenames themselves don't contain the spotlight id).
[ ] remove /CropMonitor-* from agriculture/ (these files were moved from agriculture/ to agriculture-cropmonitor/

There's a folder called airport that has data from Nov 2019 to June 2020 for spotlight tk. Is that related to detections-plane ?

olafveerman commented 3 years ago

@leothomas Can you hold off from removing the CropMonitor files? Have to double check it's not used somewhere.

leothomas commented 3 years ago

With the updated Nightlights dataset the following folders can be deleted once the updated dataset is validated in production.

The backups from the previous nightlights dataset deployment:

The staging folders from the current nightlights dataset deployment:

NASA-IMPACT / covid-api