ucscXena / XenaGoWidget

Xena Gene Set Viewer (demo: http://xenademo.berkeleybop.io/xena)
https://xenageneset.berkeleybop.io/xena/
BSD 3-Clause "New" or "Revised" License
2 stars 5 forks source link

handle large (5MB plus) files #659

Closed nathandunn closed 3 years ago

nathandunn commented 3 years ago

from #658 May need to write to files, streaming response as parsing inline seems to not work properly creating heap herrors.

nathandunn commented 3 years ago

This is mostly working by changing the fork to use a 4GB memory signature at runtime:

https://github.com/ucscXena/xena-analysis-grails/commit/8b7b19470401af0fad335c003ccf042fae691ce2#diff-49a96e7eea8a94af862798a45174e6ac43eb4f8b4bd40759b5da63ba31ec3ef7R77

The current issue now is that we can't store more than 5 MBs in session storage. However, we can simply ignore session storage and store it within the client and see what happens. That being said, the problem is really ONLY on the client.

nathandunn commented 3 years ago

There are two options:

nathandunn commented 3 years ago

Able to process the smaller one (bp-experimental), but the larger one is too big to be stored, but too large to write to an H2 databse.