search

ga4gh / task-execution-schemas

Apache License 2.0
80 stars 27 forks source link

Proposal: Add ability to optionally localize input files for tasks #182

Closed vsmalladi closed 1 year ago

vsmalladi commented 1 year ago

Problem: Cromwell's GCP backend supports optional localization of files, such as in this example: https://github.com/broadinstitute/warp/blob/2b0493125cae26b71fb8eecf278d63104c573772/tasks/broad/ImputationTasks.wdl#L95

Add the ability to choose to localize or stream files for tasks.

Solution Add in new localize variable to tesInputs

Linked to this issue: https://github.com/microsoft/CromwellOnAzure/issues/419

kellrott commented 1 year ago

I believe this overlaps with issue #156 and PR #157

vsmalladi commented 1 year ago

@kellrott Yes it seems to. We might want to discuss what the best term to call this is and what the default behavior is between streaming and localizing.

Adding @MattMcL4475 to the discussion.

vsmalladi commented 1 year ago

closing issue will be covered by issue #156 and PR #157