DOI-USGS / lake-temperature-model-prep

Pipeline #1
Other
6 stars 13 forks source link

Replace coop_all_files.rds.ind GD cache file with a local file, indicated with a hash and timestamp #250

Closed jordansread closed 2 years ago

jordansread commented 2 years ago

6_temp_coop_fetch/out/coop_all_files.rds.ind is a different type of indicator file, which includes info on when it was last built.

a recent PR changed the way this file was built so that we wouldn't lose track of re-indexing files on google drive. See here for the new recipe.

This file is now built more often and really shouldn't be a cached target since it is nearly "always stale". Having it be a cached file creates a bunch of unnecessary round trips to google. An alternative is to have this be a different type of indicator file (I toyed with a .tind for time indicator) that represents an only-local .rds file in the background.

This is not a major issue, just a potential clean-up task related to work in #231

jordansread commented 2 years ago

fixed in #249