mozilla / releases_insights

Parse various sources (hg log, apis, crashes…) to get some insights on past releases such as uplifts per beta, top crash signatures per nightly…
Mozilla Public License 2.0
25 stars 8 forks source link

Long term storing of some cache ressources #27

Closed pascalchevrel closed 2 years ago

pascalchevrel commented 2 years ago

Currently, we store external data in our cache folder with different expiration dates. The current approach works well except that we flush the whole cache at each deployment of the app so we loose data that has to be refetched and that makes some views slower than they could be as well as some views not doable in a web request if they make dozens or hundreds of external requests. This is particularly true with hg changelog of past releases that we flush.

I should investigate how to not loose immutable data stored in cache, either by modifying the Cache class (store long term data in a different sub folder or add a prefix to the items like immutable-sha1.cache…) or by modifying how we deploy on heroku in the post-install script of composer.json.

pascalchevrel commented 2 years ago

Fixed in https://github.com/pascalchevrel/releases_insights/commit/8c3dd50be36e0d1eab9ab77de48633cc6608e61d