search

ropensci / rnoaa

R interface to many NOAA data APIs
https://docs.ropensci.org/rnoaa
Other
330 stars 84 forks source link

'names' attribute [8] must be the same length as the vector [4] error #281

Closed rjbehnke closed 5 years ago

rjbehnke commented 6 years ago

I'm parsing the entire ISD data set using isd_parse, and the following errors are occurring for parallel and single core parses for the code following. I attached two files that this occurs for, but I can send more if you need me to.

Error in checkForRemoteErrors(val) : one node produced an error: 'names' attribute [8] must be the same length as the vector [4]

Error in names(object) <- nm : 'names' attribute [8] must be the same length as the vector [4]

parsed = isd_parse('I:\ISD\1975\725110-14751-1975.gz',addition=TRUE,parallel = TRUE,cores=2)

rjbehnke commented 6 years ago

I'm not sure why, but I can't get the files to upload. Here's a list of some of them.

723060-13722-1975 723080-13737-1975 723677-23054-1975 723840-23155-1975 723860-23169-1975 724880-23185-1975 724930-23230-1975 725069-99999-1975 725096-99999-1975 725110-14751-1975 725111-99999-1975 725316-99999-1975 725630-24030-1975 725680-99999-1975 726230-99999-1975 726240-99999-1975

sckott commented 6 years ago

@rjbehnke what's your session info?

rubenjbehnke commented 6 years ago

sessionInfo() R version 3.5.1 (2018-07-02) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows >= 8 x64 (build 9200)

Matrix products: default

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252 LC_MONETARY=English_United States.1252 [4] LC_NUMERIC=C LC_TIME=English_United States.1252

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] isdparser_0.2.0

loaded via a namespace (and not attached): [1] compiler_3.5.1 parallel_3.5.1 tools_3.5.1 yaml_2.2.0
Warning messages: 1: In findVar(sym, cntxt) : closing unused connection 4 (<-DESKTOP-R3OO8R5:11581) 2: In findVar(sym, cntxt) : closing unused connection 3 (<-DESKTOP-R3OO8R5:11581)

sckott commented 5 years ago

@rjbehnke sounds this concerns isdparser package, correct?

sckott commented 5 years ago

@rjbehnke pretty sure this is fixed, possibly was fixed in https://github.com/ropensci/isdparser/issues/15 a while back. i tried with two of those files and couldn't reproduce the problem, both worked fine.

can you try the dev version of isdparser and see if that works. I'll try to get that pushed to cran soon

rubenjbehnke commented 5 years ago

After installing the dev version, it works. Thank you.

Ruben

rjbehnke commented 5 years ago

Just to make sure, the files that did parse are parsed correctly, right? Or do I need to redo all of them?

sckott commented 5 years ago

what do you mean by parsed correctly? There were no errors or anything, but I didn't validate them per se

rubenjbehnke commented 5 years ago

I was referring to the files that parsed for me using the pre-development version of isdparser. I'm sure they did because there were no errors or anything, but I thought I'd ask in case there are any changes to the isd_parser function. Sorry if my question wasn't clear.