Setup regular checks to find out when results have changed

gbv / coli-ana

API to analyze DDC numbers

https://coli-conc.gbv.de/coli-ana/app/

MIT License

2 stars 0 forks source link

Setup regular checks to find out when results have changed #65

Open nichtich opened 2 years ago

nichtich commented 2 years ago

The full set of DDC notations from K10plus could be checked once a week.

nichtich commented 2 years ago

See related issues #25 and #29.

nichtich commented 2 years ago

Script coli-ana-enrich in directory k10plus contains a SQLite cache file. Basically it's one table with

notation
pica (PICA+ field, value ? if unknown)
complete (boolean, not supported yet)
timestamp

A cronjob could iterate weekly and update results. To keep a full changelog, a new row should be added when the result (pica) changed and the timestamp should be modified otherwise.

stefandesu commented 2 years ago

As far as I understand, the SQLite file is supposed to be in version control, but I can't find the file. Or am I missing something?

nichtich commented 2 years ago

No the SQLite file is not part of revision control but created (or reused) on running coli-ana-enrich. For all of K10plus its around 80 Bytes per row, so almost 100MB.