BD2KGenomics / s3am

A fast, parallel, streaming multipart uploader for S3
Other
13 stars 6 forks source link

Normalize `s3:` URL paths #38

Open hannes-ucsc opened 8 years ago

hannes-ucsc commented 8 years ago

... such that we can use Unix find to mirror entire directory trees.

Use case

find . -name '*.py' -exec s3am upload --verbose --force '{}' s3://bucket/dir/'{}' \;

This currently runs

s3am upload --verbose --force ./foo/bar.py s3://bucket/dir/./foo/bar.py

which creates the . "directory" in S3. Instead it should run

s3am upload --verbose --force ./foo/bar.py s3://bucket/dir/foo/bar.py
hannes-ucsc commented 8 years ago

Too complicated. Punting for 1.0