search

DOI-USGS / lake-temperature-model-prep

Pipeline #1
Other
6 stars 13 forks source link

new footprint crosswalks not properly using shared cache #48

Closed limnoliver closed 5 years ago

limnoliver commented 5 years ago

Not exactly sure what the solution is (yet), but I could not build wqp_want_lakes as it kept getting hung up on (already in the shared cache) 1_crosswalk_fetch/out/winslow_lakes_sf.rds.ind. This is a dependency issue that was solved with a workaround by running 

gd_get('1_crosswalk_fetch/out/winslow_lakes_sf.rds.ind')
gd_get('1_crosswalk_fetch/out/lakes_shapefile.prj.ind')
gd_get('1_crosswalk_fetch/out/lakes_shapefile.shx.ind')
gd_get('1_crosswalk_fetch/out/lakes_shapefile.dbf.ind')

So it seems the current pipeline does not trigger gd_get of the other geo files that need to come along with the shape file. I think I may have been able to just do the last 4 commands, but not sure now. Maybe the easiest solution would be to add the above file to the depends field for 1_crosswalk_fetch.

jordansread commented 5 years ago

Yes, this becomes easier if we never rely on the individual shapefile files. Instead using the .zip as the target is one way around it too.

jordansread commented 5 years ago

We no longer rely on these individual files. I think this issue no longer applies.