search

akvo / akvo-provisioning

Server and development environment provisioning data and configurations
9 stars 2 forks source link

Increase upload limit of /media/db/iati_import/ folder in RSR #277

Closed KasperBrandt closed 8 years ago

KasperBrandt commented 8 years ago

For the Cordaid import in RSR, they send us a large file (approx 120 MB) that we need to process. Our new IATI import allows for uploading that file, but the folder (/media/db/iati_import/) does not support uploads of more than 5 MB I think. Could this be increased to 150 MB or so, just for this folder?

And maybe for Test / UAT as well, while we're at it.

peeb commented 8 years ago

@orifito please close this issue if you're happy to do so.

orifito commented 8 years ago

@peeb sure, more than happy to close it :+1:

punchagan commented 7 years ago

@orifito @peeb the fix says it's temporary. I was wondering, if this is going away soon, or if there's a better fix, or if this is stay as is for the foreseeable future?

peeb commented 7 years ago

The better fix would have to be discussed and should ideally be done on the RSR side - i.e. if you have "expensive" API endpoints, they should be paginated or limited in some way and dealt with on the client.

I personally see both caching and timeout increases as the last resort.

What I would propose would be auditing and fixing expensive API calls and then disabling this timeout hack.

@orifito - thoughs?

orifito commented 7 years ago

Same than yours, paginating expensive API endpoints. Once it's done, we will be more than happy to remove such huge timeout.

punchagan commented 7 years ago

This is the client_max_body_size hack for file uploads/POSTs. But, I guess your comments still hold?

orifito commented 7 years ago

Ah I misread then... sorry! I guess that's no longer needed

peeb commented 7 years ago

I misread as well. Apologies!