neicnordic / neic-sda

NeIC Sensitive Data Archive documentation
https://neic-sda.readthedocs.io/
Apache License 2.0
1 stars 1 forks source link

Document tuning ingress configuration to handle client upload bandwidth issues #42

Open pontus opened 1 year ago

pontus commented 1 year ago

Bigpicture recently worked around an issue for uploads where the client saw 500 or 502 errors while uplaoding. We currently believe the problems was bandwidth between the client and the s3proxy.

Changing the ingress configuration from streaming to the backend (s3proxy) to buffering the body in nginx before calling on the s3proxy have helped with this.

We should document this as a possible workaround for that kind of problem.