search

Bible-Translation-Tools / BTT-Writer-Desktop

Bible Translation Tools Writer Application
https://bibletranslationtools.org/writer/
Other
3 stars 7 forks source link

Suggestion for speeding up BTT-Writer source updates #26

Open mondele opened 3 years ago

mondele commented 3 years ago

Currently, BTT-Writer needs to download many json files from the Internet and then merge these into the index.sqlite database in order to have an updated list of source texts. (The issue is similar for updating the list of languages.)

I think it would be helpful, both in time and in bandwidth (for them and for us) if we would instead have a daily job that creates an index.sqlite file on the server, according to the parameters needed by BTT-Writer. (I believe there are some differences in the index.sqlite file on Desktop and Android, so this might need to be done twice, with different paths or filenames.)

The user would then only have to download the index.sqlite file and BTT-Writer could directly merge the new data into the database. It should be considerably faster, and also less data-consuming. Currently, on poor connections, we frequently have timeouts that require starting the process over.

An additional benefit would be that if there were a problem in the catalog.json files it should throw an error on the daily build, which would give our support teams advance warning that something is wrong.

mondele commented 3 years ago

I suppose this should probably be on the pipline side of things.