search

LinkedEarth / NOAA_to_LiPD

Create an automated transformation between NOAA data and LiPD data representation
Apache License 2.0
1 stars 1 forks source link

Understanding NOAA file types #6

Open khider opened 3 years ago

khider commented 3 years ago

NOAA has various files types (e.g. formatted text file, speleothem, Alternate Format Data, Original Data and Full Metadata) for different templates. We need to explore which ones are available and which ones can be lifted automatically.

Examples: https://www.ncdc.noaa.gov/paleo-search/study/6404 https://www.ncdc.noaa.gov/paleo-search/study/14515

khider commented 3 years ago

Not a useful way to figure out whether we can lift automatically.

"Probably the most useful piece of metadata is the NOAAStudyId. We adopted the template format as we were assigning numbers in the 13000's. The cutover was fuzzy rather than sharp, but for study IDs in the higher 13000's and up, all files are in template format. "

khider commented 3 years ago

One additional caution is that some templated files are metadata only and do not contain data tables (e.g., data table is in an associated netcdf file or fire history fhx format file).

If the file extension is .nc or .fhx, then we cannot get it into LiPD