broadinstitute / seqr

web-based analysis tool for rare disease genomics
GNU Affero General Public License v3.0
176 stars 88 forks source link

Error when creating very large gene lists #1863

Open tommyli opened 3 years ago

tommyli commented 3 years ago

Describe the bug One of our researchers tried to create a very large gene list and resulted an error in the UI (see attached screenshot).

Raising this for reference only so feel free closing it. Perhaps more graceful handling in the UI? Perhaps enforcing some upper limit (but what should the threshold be? Seems quite arbitrary.).

Below are the important log messages. The "rawItems" list can be very large (hundreds to thousands). In this particular case, the gene list had 1382 ENSEMBL IDs in it.

The Django setting DATA_UPLOAD_MAX_MEMORY_SIZE defaults to 2.5 MB. Increasing this setting to 5.0 MB worked for us.

2021-05-20T03:05:38.271344471Z {"timestamp": "2021-05-20 03:05:38,270", "severity": "INFO", "httpRequest": {"requestMethod": "POST", "requestUrl": "http://seqr.mcri.edu.au:40000/api/locus_lists/create", "status": 200, "responseSize": 4095928, "userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/90.0.4430.212 Safari/537.36", "remoteIp": "172.18.0.1", "referer": "http://seqr.mcri.edu.au:40000/summary_data/gene_lists", "protocol": "HTTP/1.1"}, "requestBody": {"isPublic": false, "rawItems": "__TRUNCATED__", "name": "Mendeliome ", "description": "PanelApp Australia Version 0.7651"}, "user": "__REDACTED__", "traceback": null}
2021-05-20T03:06:15.399578383Z {"timestamp": "2021-05-20 03:06:15,399", "severity": "ERROR", "message": "Request body exceeded settings.DATA_UPLOAD_MAX_MEMORY_SIZE.", "@type": "type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent"}

Link to page(s) where bug is occurring MCRI instance of Seqr

Scope of the bug All creation of very large gene lists.

Screenshots Capture

hanars commented 3 years ago

thanks for bringing this to my attention!