peak / s5cmd

Parallel S3 and local filesystem execution tool.
MIT License
2.7k stars 239 forks source link

Sync s3 to s3 #758

Open nguyenvantruc opened 2 months ago

nguyenvantruc commented 2 months ago

Can I sync between two s3 storage? If so, what should the command look like?

salim-b commented 3 weeks ago

I don't think this is currently possible with s5cmd as we can only specify a single --endpoint-url / S3_ENDPOINT_URL as well as only a single pair of key ID and key (AWS_ACCESS_KEY_ID and AWS_SECRET_ACCESS_KEY).

Only s5cmd sync between two different regions within the same object storage provider is currently possible.

See also https://github.com/peak/s5cmd/issues/670.