aws / amazon-genomics-cli

https://aws.github.io/amazon-genomics-cli/
Apache License 2.0
147 stars 83 forks source link

FSx Lustre configuration support for multiple AGC workflows #400

Open miachamp opened 2 years ago

miachamp commented 2 years ago

Description

//: # Multiple customer requests for FSx Lustre file system integrated with AGC S3 workloads enabling faster compute access and higher throughput. Recent Loka update to cromwell (gatk-sv) leveraging FSxL [https://github.com/goldfinchbio/aws-gatk-sv.]. MiniWDL users also interested in FSxL.

michaelbarton commented 2 years ago

This would be great to have as a feature. One of the creators of nextflow has reported that FSx lustre gives better performance than using s3:

https://twitter.com/PaoloDiTommaso/status/1523681747854327815