aws-quickstart / quickstart-illumina-dragen

AWS Quick Start Team
Apache License 2.0
24 stars 26 forks source link

The solution is to expensive to use by default #48

Open markotitel opened 3 years ago

markotitel commented 3 years ago

Hi,

I've submitted a ticket to Illumina in regards to interesting issue with dragen tool.

Ticket number # 02507153

To stream the input FastQ files with -1 s3://... and -2 s3://... dragen needs Internet connection.

Dragen software is not able to download object from S3 using regional S3 Gateway VPC Endpoint. The error returned: _Could not connect to remote endpoint._

This example utilizes NAT gateways. In production use with a 1000s of GB of data this solution incurss a lot of NAT traffic billing