issues
search
BD2KGenomics
/
s3am
A fast, parallel, streaming multipart uploader for S3
Other
13
stars
6
forks
source link
Improvements for uploading multiple files
#26
Closed
hannes-ucsc
closed
8 years ago
hannes-ucsc
commented
8 years ago
implement "s3am upload-dir" (it should skip files that already exist unless --overwrite is passed)
foo vs foo/ vs foo/prefix*
add progress information
implement "s3am generate-key FILE" to generate a master key
compute etag locally for validation
hannes-ucsc
commented
8 years ago
we'll punt on
upload-dir
since Unix
find
can do that but we'll add --overwrite (#30).
progress info can be achieved with --verbose
s3am generate-key FILE is tracked as (#33)
hannes-ucsc
commented
8 years ago
foo vs foo/ vs foo/prefix* will be fixed (#29 and #27)
hannes-ucsc
commented
8 years ago
compute etag locally for validation tracked separately (#34)
implement "s3am upload-dir" (it should skip files that already exist unless --overwrite is passed)foo vs foo/ vs foo/prefix*add progress informationimplement "s3am generate-key FILE" to generate a master keycompute etag locally for validation