issues
search
Joystream
/
joystream
Joystream Monorepo
http://www.joystream.org
GNU General Public License v3.0
1.42k
stars
115
forks
source link
Colossus S3 api implementation
#5139
Closed
ignazio-bovo
closed
3 months ago
ignazio-bovo
commented
5 months ago
Progress
[x] edit controller logic to incorporate s3 upload and file fetching for user request on
filesApi.get
[x] document upload object flow
[x] improve in memory cache logic for stored objects
[x] improve custom multer Storage engine implementation in order to accomodate upload request
[x] define Abstract class for generic cloud storage provider
[x] Document new class hierarchy
[x] Adapt synch flow for connection handler (est. 4hrs)
[x] implement
ConnectionHandler
for the aws typescript api (est 4hrs)
[x] if necessary augment
AbstractConnectionHandler
for getting a list of assets on the cloud bucket for local cache setup
[x] Add member to object cache for object that it is stored on remote bucket 10 min
[x] Files Api should detect whether file is on remote or simply return 30 min
[x] Accept data object should upload the file and add its location (either on local volume or remote to the cache) 2hrs
[x] Get file should get the file from remote using Abstract connection handler and pipe the stream to the request 2hrs
[x] Revert Changes on storage engine (only accepted objects should be added to the bucket) 2 min
[x] Refactor abstract connection handler using only async parts: 10 mins
Progress
filesApi.get
ConnectionHandler
for the aws typescript api (est 4hrs)AbstractConnectionHandler
for getting a list of assets on the cloud bucket for local cache setup