Large file upload error " Key not found "

massalabs / station

A gateway to the Massa blockchain

https://station.massa.net

27 stars 69 forks source link

Large file upload error " Key not found " #1169

Closed AltayDev closed 11 months ago

AltayDev commented 1 year ago

The problem(s) It takes 29 minutes to upload zip files larger than 14 MB and then error.

To Reproduce My Steps

I converted my build to .zip.
If MassaStation is open, I completely exited the icon and restarted it with the parameter $env:UPLOAD_MAX_SIZE = "1000000000".
I entered this code to upload my file: curl -X PUT -F "url=name" -F "nickname=Altay" -F "description=website des" -F "zipfile=@build.zip" http://station.massa/websiteUploader/prepare
gave the above error after an average of 20 minutes

MassaStation version massastation_0.3.4_amd64.msi

Desktop (please complete the following information):

OS: Windows 11

Thykof commented 1 year ago

The problem is due to the fact that the cache item has a lifetime of 20 minutes. So if user upload a large file, the loading time can be higher than 20 minutes and the correlation ID of the batch request is removed from the cache.

We will improve how we handle batch request.

Thykof commented 1 year ago

thanks to https://github.com/massalabs/station-massa-wallet/pull/778 the developer will be able to customize the cache lifetime by setting this environment variable: BATCH_EXPIRATION_TIME

The value must follow input requirement of https://pkg.go.dev/time#ParseDuration, for example "50m" for 50 minutes

gregLibert commented 11 months ago

@AltayDev is this still blocking you? if not, @SlnPons I suggest to improve that in the woc rework.

SlnPons commented 11 months ago

As we got no answer, I'll close this issue and I can confirm you that the upload speed is part of the improvements identified for this product :)