Request cpuPlatform: "Intel Ice Lake" in the runtime block for tasks that tend to localize very large input Files (kraken, demux, etc). Switches from gsutil to gcloud storage and supposedly sees a 10x speedup in data localization (from 1Gbps to 10Gbps).
Per recent updates on Terra's side: https://support.terra.bio/hc/en-us/articles/22607611273115-February-1-2024
Request
cpuPlatform: "Intel Ice Lake"
in the runtime block for tasks that tend to localize very large input Files (kraken, demux, etc). Switches fromgsutil
togcloud storage
and supposedly sees a 10x speedup in data localization (from 1Gbps to 10Gbps).