nextflow-io / nextflow-s3fs

An S3 File System Provider for Java 7 (project archived)
Apache License 2.0
1 stars 10 forks source link

Implement automatic error failover for multipart upload #4

Closed pditommaso closed 8 years ago

pditommaso commented 8 years ago

Multipart upload splits a file in chunk and upload each chunk independently. If one of these uploads stop due to a network hiccup or a similar problem it stops the overall upload process.

Instead of aborting the overall process, the single chunk upload should be retried for a given maxim number of attempts.