databio / LOLAweb

An interactive Shiny web application for genomic interval enrichment analysis using LOLA.
http://lolaweb.databio.org/
16 stars 2 forks source link

longer-term archival of results #68

Open nsheff opened 6 years ago

nsheff commented 6 years ago

Feature suggestion by @fhalbritter

I think it would be good to have an option for long(er)-term archival of selected results so that people can directly link to dynamic results pages from publications and websites.

nsheff commented 6 years ago

here's a cool idea: making it really easy for someone to set up their own webserver running just the interactive component of this, so they could include it as a webpage with a publication.

or, another way we could accomplish this: allow posting a link to an archive file (a la #67) available online; our server could download that archive and display the interactive results. Then we don't have to store them, but they can still publish an interactive viewer.

nmagee commented 6 years ago

I'd be interested to know how large 1000 result caches would be, for long-term storage. A few GB?

nsheff commented 6 years ago

well the 224 we have now are 181MB. So 1000 ought to be under 2GB.

nmagee commented 6 years ago

Great. So I see no reason to purge them if we don't need/have to. We could store them locally, or we could even throw them up into S3, if you wanted.

nsheff commented 6 years ago

Until there are 1,000,000 of them :smile:

nmagee commented 6 years ago

ha! Bring it on!!

fhalbritter commented 6 years ago

sounds like archival wouldn't create any real headaches.

to make it even more manageable, you could by default delete all results on your server periodically (or whichever way you do it right now) and keep only those were the user pressed a "save" button on the results page