Add option to leave tarfile in the queue after processing

landsat-pds / landsat_ingestor

Scripts and other artifacts for landsat data ingestion into Amazon public hosting.

Apache License 2.0

102 stars 18 forks source link

Add option to leave tarfile in the queue after processing #22

Closed joferkington closed 5 years ago

joferkington commented 5 years ago

In order to allow more flexibility in processing, it would be useful to have an option to leave processed tarfiles in the s3 queue after successful processing with l8_process_scene.py.

This PR adds a --no-delete-queue option that, if specified, leaves processed scenes in the queue.

joferkington commented 5 years ago

cc @kapadia

kapadia commented 5 years ago

Looks fine, just note that if the tarball is not removed from the s3://landsat-pds/tarq bucket, it will be reprocessed again, and be recorded in the scene_list.csv again.