search

bihealth / sodar-server

SODAR: System for Omics Data Access and Retrieval
https://github.com/bihealth/sodar-server
MIT License
14 stars 3 forks source link

Server slowdowns when using iRODS and landingzones #210

Closed mikkonie closed 2 years ago

mikkonie commented 6 years ago

Manuel reported severe server slowdowns when uploading files from Landingzones and leaving browser windows open.

This seems to be caused by Ajax calls towards iRODS.

mikkonie commented 6 years ago

I am able to reproduce the issue, this simply is caused by some of the ajax requests blocking other stuff. I should try limiting the amount of queries I do on the landingzones page anyway, but first I'll try re-configuring gunicorn with -k gevent and some other tweaks. Might help.

mikkonie commented 6 years ago

I set up the omics_data_mgmt gunicorn properly with gevent. This SHOULD help at least as synchronous requests don't block stuff.

Gevent doesn't work with omics_taskflow, probably because of the threads I have running inside the application for async calls. Oh well, sync engine with enough workers should keep us going for some time.

mikkonie commented 6 years ago

mentioned in commit 7f487c8aa368e7d5e6d1e2646595dba80e324ecf

mikkonie commented 6 years ago

At least the original cause for this has been eliminated. Will reopen or create a new issue if similar problems arise again.

mikkonie commented 6 years ago

closed