Hixon10 / openjdk-mailing-lists-search-old

Search for openjdk mailing lists
https://hixon10.github.io/openjdk-mailing-lists-search/
MIT License
1 stars 0 forks source link

Support large (>100 MB) database size #11

Closed Hixon10 closed 2 years ago

Hixon10 commented 2 years ago

At present we cannot use large (> 100 MB) databases, because github doesn't allow to store such files to git, and it forces to use https://git-lfs.github.com/ instead of. That's fine, but we cannot use Git LFS, because Github pages doesn't support embedding of LFS. So, we need to implement workaround.

Let's try the following solution:

  1. split sqlite database to several files after creating of index.
  2. Download all parts on web-frontend.
  3. Combine the parts to one database, which will be used for queries.