Multi-Part Upload - Githubissues

ACED-IDP / devops

Playbooks and scripts

1 stars 0 forks source link

Multi-Part Upload #3

Open bwalsh opened 1 year ago

bwalsh commented 1 year ago

As a ACED informatician, in order to reliably and predictably upload very large files, I need a multi-part upload capability.

This issue is blocked because:

the Gen3 Fence service's multi-part endpoints do not support a bucket parameter
the Gen3 data-client application does not support a bucket parameter
the Gen3 python SDK has no multi part upload methods at all

https://cdis.slack.com/archives/CDDPLU1NU/p1682863811731579 https://cdis.slack.com/archives/CDDPLU1NU/p1682829809798569 https://ohsucomputationalbio.slack.com/archives/C043HPV0VMY/p1683038288801759?thread_ts=1682829864.738419&cid=C043HPV0VMY

lbeckman314 commented 1 year ago

Multipart Bucket PR from Binam: https://github.com/uc-cdis/fence/compare/feat/multi_part_bucket_param