search

juicedata / juicesync

A tool to move your data between any clouds or regions.
Apache License 2.0
593 stars 56 forks source link

server-side-copy when src and destination support it #144

Closed Slach closed 11 months ago

Slach commented 1 year ago

could we implements feature which will use s3:CopyObject API https://github.com/awsdocs/aws-doc-sdk-examples/blob/main/gov2/s3/actions/bucket_basics.go#L202 when we try to sync s3:// -> s3:// ?

for gcs:// -> gcs:// https://cloud.google.com/storage/docs/samples/storage-copy-file

etc.

davies commented 11 months ago

The server-side-copy is only useful when copy objects with same vendor, region and account. Also the S3 server may still need to copy the data which means the COPY request will not be much faster than GET and PUT, we only save the bandwidth.

So the benefits may not worth the effort, we don't have a plan for it.