search

NIEHS / beethoven

BEETHOVEN is: Building an Extensible, rEproducible, Test-driven, Harmonized, Open-source, Versioned, ENsemble model for air quality
https://niehs.github.io/beethoven/
Other
2 stars 0 forks source link

Create a .csv table with metadata on downloaded files #249

Closed sigmafelix closed 3 months ago

sigmafelix commented 6 months ago

@Spatiotemporal-Exposures-and-Toxicology For the sake of generalizability, I am creating a .csv table stored in inst/extdata (for the moment) with metadata on raw covariate files: data name, storage folder and file name. I use it to extract testdata on Durham county.

sigmafelix commented 6 months ago

Draft by @eva0marques. I am not sure why the draft-issue conversion assigns me as an author. I think this is a great idea for the pipeline as well.

eva0marques commented 5 months ago

Change folder path to a secured path

kyle-messier commented 3 months ago

@sigmafelix Re-opening since we are updating the lookup tables

eva0marques commented 3 months ago

@kyle-messier @sigmafelix I agree, maybe this file is outdated now (also because we have very nice naming conventions now for files!!!), I'll check if there are things I need to complete in the lookup table.

kyle-messier commented 3 months ago

@eva0marques We still need a lookup table for the targets pipeline - most likely.

kyle-messier commented 3 months ago

ahh, @eva0marques I didn't realize this was a lookup table specific for absolute paths on the ddn. We'll keep it open and under review on the board until we know more on its need.

eva0marques commented 3 months ago

My apologies, I meant MY file is outdated, not Insang's one!!! I think Insang's idea is very good. I will just see if I have stuff to merge to his file from mine. Well, for the absolute path, we should remove them from everywhere... no? We don't really need them.