search

ised-isde-canada / cbmdsp-cp-sp-overall-architecture

1 stars 1 forks source link

Task: Test Portal type 1 (browser JS client) around S3 put via multipart presigned URL(s) ManagedUpload library #18

Open obriensystems opened 3 years ago

obriensystems commented 3 years ago

could not assign yet to BrianFanning

obriensystems commented 3 years ago

checking on assignment by commenting with assigner @BrianFanning

obriensystems commented 3 years ago

Checking assignment by referencing already assigned #2

BrianFanning commented 3 years ago

test comment

BrianFanning commented 3 years ago

I have a working version of what I described here: https://github.com/ised-isde-canada/cbmdsp-cp-sp-overall-architecture/issues/2#issuecomment-859196256 with an API Gateway + Python Lambda function working as the API backend between the client and the S3 control plane to create MP uploads / generate URLs / complete MP uploads.

My client is a very simple python script, and at the moment uploads to the pre-signed URLs are sequential rather than concurrent, I can work on that next. The upload chunk size is configurable so we can play around with the optimal size for users uploading files.

Can discuss more / demo on Thurs/Fri

obriensystems commented 3 years ago

very nice Brian, we can review thursday, the code/functionality