ropensci / FedData

Functions to Automate Downloading Geospatial Data Available from Several Federated Data Sources
https://docs.ropensci.org/FedData
Other
96 stars 22 forks source link

Download raw measurements with get_itrdb #35

Open djhocking opened 6 years ago

djhocking commented 6 years ago

I am using the get_itrdb() function and it works but misses some records. I checked to see if it was an extraction issue but they seem to be missing from the RAW/ downloads folder. For example, if I go to the ITRDB webpage and select all records for eastern red cedar (Species code == JUVI) I get the results for 26 studies including (TN031). When I run the code:

ITRDB <- get_itrdb(template = NULL, label='JUVI', species = "JUVI", makeSpatial = TRUE, force.redo = TRUE)

I get some of the same studies but am missing TN031 among others. It is not in the list of files that could not be extracted and seems to be missing from the downloads. The XML metadata for the study can be found at: https://www1.ncdc.noaa.gov/pub/data/metadata/published/paleo/dif/xml/noaa-tree-12716.xml and the JSON at: [https://www.ncdc.noaa.gov/paleo-search/study/search.json?xmlId=10776](https://www.ncdc.noaa.gov/paleo-search/study/search.json?xmlId=10776

I used the FedData version pulled from GitHub to make sure I was using the most up-to-date version (although not the development version).

bocinsky commented 6 years ago

Hi there, and thanks for submitting an issue. For various reasons, FedData uses the latest archived version of the ITRDB chronologies dataset, which as of now is version v713 dating to August 8, 2017. It appears that “TN031” is only available as raw measurements, and not as a chronology. I hope to provide access to the raw measurements in the next major release of FedData, but dev time is slow-going for me at the moment. I’ll add this as a feature goal.

On Jan 24, 2018, at 10:37 AM, Daniel J. Hocking notifications@github.com wrote:

I am using the get_itrdb() function and it works but misses some records. I checked to see if it was an extraction issue but they seem to be missing from the RAW/ downloads folder. For example, if I go to the ITRDB webpage and select all records for eastern red cedar (Species code == JUVI) I get the results for 26 studies including (TN031). When I run the code:

ITRDB <- get_itrdb(template = NULL, label='JUVI', species = "JUVI", makeSpatial = TRUE, force.redo = TRUE) I get some of the same studies but am missing TN031 among others. It is not in the list of files that could not be extracted and seems to be missing from the downloads. The XML metadata for the study can be found at: https://www1.ncdc.noaa.gov/pub/data/metadata/published/paleo/dif/xml/noaa-tree-12716.xml https://www1.ncdc.noaa.gov/pub/data/metadata/published/paleo/dif/xml/noaa-tree-12716.xml and the JSON at: [https://www.ncdc.noaa.gov/paleo-search/study/search.json?xmlId=10776](https://www.ncdc.noaa.gov/paleo-search/study/search.json?xmlId=10776 https://www.ncdc.noaa.gov/paleo-search/study/search.json?xmlId=10776 I used the FedData version pulled from GitHub to make sure I was using the most up-to-date version (although not the development version).

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ropensci/FedData/issues/35, or mute the thread https://github.com/notifications/unsubscribe-auth/AH8pM8rafOM7xDpfWbYRFDbJAuiNsZk3ks5tN2pxgaJpZM4RrpHH.