search

OllyButters / puma

Getting, analysing and displaying lists of papers
https://ollybutters.github.io/puma_web
GNU General Public License v3.0
13 stars 4 forks source link

Better cache invalidation #112

Open OllyButters opened 9 months ago

OllyButters commented 9 months ago

Zotero and pubmed files now have a cache invalidation timeframe on them, but this won't work for the github hosted cache files since the timestamp won't update if they are the same, which means they will be redownloaded everytime it runs. This makes a mockery of the cache! Short term hack might be to set the cache invalidation to a very big number (10000+) on some datasets where I know zotero is static.

OllyButters commented 9 months ago

Note this is handled outside of PUMA in in azure at https://github.com/OllyButters/puma_web/blob/75a6a798e19adf96251ba0aa5146d7268d71d70a/azure-pipelines.yml#L107 to deal with this, but could probably do with a better solution.