epam / cloud-pipeline

Cloud agnostic genomics analysis, scientific computation and storage platform
https://cloud-pipeline.com
Apache License 2.0
144 stars 58 forks source link

Pipe CLI: enable checksum calculation for S3 #3524

Closed ekazachkova closed 1 month ago

ekazachkova commented 1 month ago

This PR provides initial implementation for issue #3512

To enable additional checksum calculation a new option --checksum-algorithm has been introduced.

Supported algorithms: sha256, crc32 and md5 (default)

Also, a new option --checksum-skip has been implemented. This flag allows to disable data integrity validations.