Closed muhamadazmy closed 10 months ago
rfs can upload/download multiple files in parallel but it seems this s3 client can't handle this correctly so random issues appear during upload
this trick is to force the store to do synched read/write but the problem is it hurts pefromance badly.
Instead we should find a better client since this issue is too old (2018)
https://github.com/awslabs/aws-sdk-rust/tree/main/sdk/s3
rfs can upload/download multiple files in parallel but it seems this s3 client can't handle this correctly so random issues appear during upload
this trick is to force the store to do synched read/write but the problem is it hurts pefromance badly.
Instead we should find a better client since this issue is too old (2018)
https://github.com/awslabs/aws-sdk-rust/tree/main/sdk/s3