search

mountetna / timur

Data browser for biologists
GNU General Public License v2.0
3 stars 6 forks source link

Cannot generate/download TSV from populations table #52

Closed meghanz closed 7 years ago

meghanz commented 7 years ago

Getting the following error when trying to download the latest version of populations table from TIMUR:

'Your attempt to create a .tsv failed, Error: Internal Service Error'

graft commented 7 years ago

I was looking at this all day - this is basically a result of the same issue causing the population table (etc.) to load slowly on the flow cytometry tab - viz., retrieving a large number of records is slow. It seems this is because turning SQL rows into ruby objects is slow. This needs to be faster, but also the request should not time out.

If this is bad (for 220,000 population records), it will be worse for gene expression (4M records per plate).

graft commented 7 years ago

Ok, this takes 75 seconds but is possible. We'll have to improve this soon in order to make gene expression downloads viable, or maybe use background worker threads.