search

minio / mc

Simple | Fast tool to manage MinIO clusters :cloud:
https://min.io/download
GNU Affero General Public License v3.0
2.79k stars 531 forks source link

how to mirror or copy files based on checksum #2721

Closed hosnas closed 5 years ago

hosnas commented 5 years ago

Sorry If I'm asking this question in the wrong place.

I want to transfer files based on checksum (not based on modification time or size) . What should I do to achieve this? I checked the normal behavior and it didn't compare checksum while transferring files.

harshavardhana commented 5 years ago

It's not possible our behavior is similar to aws sync - modtime and size are used to compare and copy.

hosnas commented 5 years ago

@harshavardhana not possible at all? or its not implemented yet? cause s3cmd and rclone can simply do it. I was very disappointed by this behavior. I transferred a folder to my bucket. then copied that folder to another place in my local then tried to transfer the copy to same bucket. All files were transferred again just because modification times were altered. The point is in many situations we cant really rely on modification time.

harshavardhana commented 5 years ago

Checksum involves downloading data on both ends, mc is not just about copying from local folder to object storage. But copying PetaByte worth of contents from one object storage to another so technically it's not feasible.

S3cmd and rclone are good alternatives here.

lock[bot] commented 4 years ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.