allometric / models

A repository of allometric model files and parameters.
https://allometric.org
6 stars 1 forks source link

Optimize running of publication files #45

Open brycefrank opened 9 months ago

brycefrank commented 9 months ago

Currently, all publication files are ran each time we push to main. Instead, we could check which publication and parameter files are updated from the previous commit and only rerun those. The process would look like:

  1. Push to main.
  2. Build a list of changed files from previous commit
  3. Rerun only those publications that have changed, storing the publication list in memory
  4. Load models.RDS into memory
  5. Delete all old copies of models matching the list in (3)
  6. Insert new models into dataframe
  7. Rewrite models.RDS

We should allow for an action that reruns all pub files if desired.