mojodna / osm-pds-pipelines

OSM PDS pipeline
https://quay.io/repository/mojodna/osm-pds-pipelines
ISC License
31 stars 4 forks source link

When Batch transcoding fails, delete the target object on S3 #23

Open mojodna opened 6 years ago

mojodna commented 6 years ago

This will prevent incomplete ORC files from being stored on S3 and will facilitate retries (if objects already exist, subsequent attempts fails immediately).