valerebinet-NIA / Textrous

Textrous! retrieves English words from a gene set. extrous! aims to search "gene-documents", collections of genes and their associated literature based upon databases from PubMed, Jackson Laboratories, and the Online Mendelian Inheritance in Man.
Creative Commons Zero v1.0 Universal
1 stars 2 forks source link

Create deployable pickle alternatives #3

Open Helveg opened 3 years ago

Helveg commented 3 years ago

A lot of the cached data is stored in pickle files that are currently stored in Git LFS.

It would be better if the script that generated those pickles would be stored in the repository, and deploy scripts are added that can deploy the data to some target database or other rapid data structure together with the web app. (depending on what's in the pickles we'd want to have some sort of indexing like a db or hdf5)