search

ajdamico / asdfree

analyze survey data for free
http://asdfree.com/
GNU General Public License v3.0
612 stars 449 forks source link

PSID lodown Issue #369

Closed nappyswheel closed 10 months ago

nappyswheel commented 2 years ago

Getting an error when I attempt to use lodown with the panel study of income dynamics (email/pw changed below):

library(lodown)

lodown( "psid" , output_dir = file.path( path.expand( "~" ) , "PSID" ) ,

  • your_email = "myemail@myemail.org" ,
  • your_password = "mypassword" ) building catalog for psid

locally downloading psid

R version 4.1.2 (2021-11-01) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows 10 x64 (build 19043)

Matrix products: default

Random number generation: RNG: Mersenne-Twister Normal: Inversion Sample: Rounding

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252
[3] LC_MONETARY=English_United States.1252 LC_NUMERIC=C
[5] LC_TIME=English_United States.1252

attached base packages: [1] grid stats graphics grDevices utils datasets methods base

other attached packages: [1] foreign_0.8-82 ggplot2_3.3.5 mitools_2.4 survey_4.1-1 survival_3.2-13 [6] Matrix_1.3-4 lodown_0.1.0

loaded via a namespace (and not attached): [1] pillar_1.7.0 compiler_4.1.2 bitops_1.0-7 forcats_0.5.1 tools_4.1.2
[6] digest_0.6.29 lifecycle_1.0.1 tibble_3.1.6 gtable_0.3.0 lattice_0.20-45 [11] pkgconfig_2.0.3 rlang_1.0.2 cli_3.2.0 DBI_1.1.2 curl_4.3.2
[16] haven_2.4.3 stringr_1.4.0 httr_1.4.2 xml2_1.3.3 withr_2.5.0
[21] dplyr_1.0.8 generics_0.1.2 vctrs_0.4.0 hms_1.1.1 tidyselect_1.1.2 [26] glue_1.6.2 R6_2.5.1 fansi_1.0.3 selectr_0.4-2 farver_2.1.0
[31] tzdb_0.3.0 readr_2.1.2 purrr_0.3.4 magrittr_2.0.3 scales_1.1.1
[36] ellipsis_0.3.2 splines_4.1.2 rvest_1.0.2 assertthat_0.2.1 colorspace_2.0-3 [41] labeling_0.4.2 utf8_1.2.2 stringi_1.7.6 RCurl_1.98-1.6 munsell_0.5.0
[46] crayon_1.5.1

lodown is now exiting unexpectedly. websites that host publicly-downloadable microdata change often and sometimes those changes cause this software to break. if the error call stack below appears to be a hiccup in your internet connection, then please verify your connectivity and retry the download. otherwise, please open a new issue at https://github.com/ajdamico/asdfree/issues with the contents of this error call stack and also the output of your sessionInfo().

[[1]] lodown("psid", output_dir = file.path(path.expand("~"), "PSID"), your_email = "matthew.eckel@younginvincibles.org", your_password = "billgtes2010")

[[2]] withCallingHandlers(catalog <- load_fun(data_name = data_name, catalog, ...), error = function(e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } })

[[3]] load_fun(data_name = data_name, catalog, ...)

[[4]] RCurl::getURL("https://simba.isr.umich.edu/u/Login.aspx", curl = curl)

[[5]] curlPerform(curl = curl, .opts = opts, .encoding = .encoding)

[[6]] function (type, msg, asError = TRUE) { if (!is.character(type)) { i = match(type, CURLcodeValues) typeName = if (is.na(i)) character() else names(CURLcodeValues)[i] } typeName = gsub("^CURLE_", "", typeName) fun = (if (asError) stop else warning) fun(structure(list(message = msg, call = sys.call()), class = c(typeName, "GenericCurlError", "error", "condition"))) }(35L, "Unknown SSL protocol error in connection to simba.isr.umich.edu:443 ", TRUE)

[[7]] fun(structure(list(message = msg, call = sys.call()), class = c(typeName, "GenericCurlError", "error", "condition")))

[[8]] (function (e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_errornote) print(sys.calls()) } })(list(message = "Unknown SSL protocol error in connection to simba.isr.umich.edu:443 ", call = function (type, msg, asError = TRUE) { if (!is.character(type)) { i = match(type, CURLcodeValues) typeName = if (is.na(i)) character() else names(CURLcodeValues)[i] } typeName = gsub("^CURLE", "", typeName) fun = (if (asError) stop else warning) fun(structure(list(message = msg, call = sys.call()), class = c(typeName, "GenericCurlError", "error", "condition"))) }(35L, "Unknown SSL protocol error in connection to simba.isr.umich.edu:443 ", TRUE)))

Error in function (type, msg, asError = TRUE) : Unknown SSL protocol error in connection to simba.isr.umich.edu:443 full_url 4 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1056&mainurl=Y 5 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1058&mainurl=Y 7 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1059&mainurl=Y 8 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1060&mainurl=Y 9 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1061&mainurl=Y 10 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1062&mainurl=Y 11 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1063&mainurl=Y 12 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1064&mainurl=Y 13 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1065&mainurl=Y 14 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1066&mainurl=Y 15 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1067&mainurl=Y 16 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1068&mainurl=Y 18 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1069&mainurl=Y 19 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1070&mainurl=Y 20 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1071&mainurl=Y 21 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1072&mainurl=Y 22 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1073&mainurl=Y 23 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1147&mainurl=Y 24 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1074&mainurl=Y 25 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1075&mainurl=Y 26 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1076&mainurl=Y 27 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1077&mainurl=Y 28 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1078&mainurl=Y 29 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1148&mainurl=Y 31 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1079&mainurl=Y 32 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1080&mainurl=Y 33 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1081&mainurl=Y 34 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1082&mainurl=Y 35 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1047&mainurl=Y 36 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1149&mainurl=Y 37 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1048&mainurl=Y 38 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1049&mainurl=Y 39 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1050&mainurl=Y 40 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1051&mainurl=Y 41 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1150&mainurl=Y 43 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1040&mainurl=Y 44 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1130&mainurl=Y 45 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1052&mainurl=Y 46 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1131&mainurl=Y 47 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1132&mainurl=Y 48 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1133&mainurl=Y 49 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1139&mainurl=Y 50 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1140&mainurl=Y 51 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1152&mainurl=Y 53 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1156&mainurl=Y 54 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1164&mainurl=Y 55 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1183&mainurl=Y 56 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1187&mainurl=Y 57 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1194&mainurl=Y 58 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1053&mainurl=Y 59 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1121&mainurl=Y 60 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1109&mainurl=Y 61 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1123&mainurl=Y 62 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1165&mainurl=Y 63 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1188&mainurl=Y 64 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1175&mainurl=Y 68 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1193&mainurl=Y 69 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1174&mainurl=Y 70 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1170&mainurl=Y 71 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1173&mainurl=Y 72 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1200&mainurl=Y 73 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1199&mainurl=Y 74 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1201&mainurl=Y 76 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1166&mainurl=Y 77 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1167&mainurl=Y 78 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1168&mainurl=Y 79 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1169&mainurl=Y 80 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1172&mainurl=Y 81 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1184&mainurl=Y 82 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1189&mainurl=Y 83 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1196&mainurl=Y 85 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1145&mainurl=Y 86 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1161&mainurl=Y 88 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1163&mainurl=Y 89 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1177&mainurl=Y 91 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1097&mainurl=Y 92 https://simba.isr.umich.edu/Zips/GetFileCDS.aspx?file=1159&mainurl=Y table_name directory year 4 1968 Family Files 1968 5 1969 Family Files 1969 7 1970 Family Files 1970 8 1971 Family Files 1971 9 1972 Family Files 1972 10 1973 Family Files 1973 11 1974 Family Files 1974 12 1975 Family Files 1975 13 1976 Family Files 1976 14 1977 Family Files 1977 15 1978 Family Files 1978 16 1979 Family Files 1979 18 1980 Family Files 1980 19 1981 Family Files 1981 20 1982 Family Files 1982 21 1983 Family Files 1983 22 1984 Family Files 1984 23 1984 Wealth Family Files 1984 24 1985 Family Files 1985 25 1986 Family Files 1986 26 1987 Family Files 1987 27 1988 Family Files 1988 28 1989 Family Files 1989 29 1989 Wealth Family Files 1989 31 1990 Family Files 1990 32 1991 Family Files 1991 33 1992 Family Files 1992 34 1993 Family Files 1993 35 1994 Family Files 1994 36 1994 Wealth Family Files 1994 37 1995 Family Files 1995 38 1996 Family Files 1996 39 1997 Family Files 1997 40 1999 Family Files 1999 41 1999 Wealth Family Files 1999 43 2001 Family Files 2001 44 2001 Wealth Family Files 2001 45 2003 Family Files 2003 46 2003 Wealth Family Files 2003 47 2005 Family Files 2005 48 2005 Wealth Family Files 2005 49 2007 Family Files 2007 50 2007 Wealth Family Files 2007 51 2009 Family Files 2009 53 2011 Family Files 2011 54 2013 Family Files 2013 55 2015 Family Files 2015 56 2017 Family Files 2017 57 2019 Family Files 2019 58 Cross-year Individual: 1968-2019 Family Files 59 Marriage History: 1985-2019 Family Files 60 Childbirth & Adoption History: 1985-2019 Family Files 61 Parent Identification: 2019 Family Files 62 Pregnancy Intentions: 2013-2019 Family Files 63 Family Relationship Matrix: 1968-2019 Family Files 64 Active Savings: 1989, 1994 Family Files 68 1997 Child Development Supplement 1997 69 2002 Child Development Supplement 2002 70 2007 Child Development Supplement 2007 71 2014 Child Development Supplement 2014 72 2019 Child Development Supplement 2019 73 Sensitive Data Variables Child Development Supplement 74 2020 Child Development Supplement 2020 76 2005 Transition into Adulthood Supplement 2005 77 2007 Transition into Adulthood Supplement 2007 78 2009 Transition into Adulthood Supplement 2009 79 2011 Transition into Adulthood Supplement 2011 80 2013 Transition into Adulthood Supplement 2013 81 2015 Transition into Adulthood Supplement 2015 82 2017 Transition into Adulthood Supplement 2017 83 2019 Transition into Adulthood Supplement 2019 85 2009 Disability and Use of Time 2009 86 2013 Disability and Use of Time 2013 88 2014 Childhood Retrospective Circumstances Web (Mixed Mode) Supplements 2014 89 2016 WellBeing and Daily Life Web (Mixed Mode) Supplements 2016 91 1988 Time and Money Transfer Intergenerational Transfers 1988 92 2013 Family Rosters and Transfers Intergenerational Transfers 2013 type 4 Family Files 5 Family Files 7 Family Files 8 Family Files 9 Family Files 10 Family Files 11 Family Files 12 Family Files 13 Family Files 14 Family Files 15 Family Files 16 Family Files 18 Family Files 19 Family Files 20 Family Files 21 Family Files 22 Family Files 23 Wealth Files 24 Family Files 25 Family Files 26 Family Files 27 Family Files 28 Family Files 29 Wealth Files 31 Family Files 32 Family Files 33 Family Files 34 Family Files 35 Family Files 36 Wealth Files 37 Family Files 38 Family Files 39 Family Files 40 Family Files 41 Wealth Files 43 Family Files 44 Wealth Files 45 Family Files 46 Wealth Files 47 Family Files 48 Wealth Files 49 Family Files 50 Wealth Files 51 Family Files 53 Family Files 54 Family Files 55 Family Files 56 Family Files 57 Family Files 58 Family Files 59 Family Files 60 Family Files 61 Family Files 62 Family Files 63 Family Files 64 Family Files 68 Child Development Supplement 69 Child Development Supplement 70 Child Development Supplement 71 Child Development Supplement 72 Child Development Supplement 73 Child Development Supplement 74 Child Development Supplement 76 Transition into Adulthood Supplement 77 Transition into Adulthood Supplement 78 Transition into Adulthood Supplement 79 Transition into Adulthood Supplement 80 Transition into Adulthood Supplement 81 Transition into Adulthood Supplement 82 Transition into Adulthood Supplement 83 Transition into Adulthood Supplement 85 Disability and Use of Time 86 Disability and Use of Time 88 Web (Mixed Mode) Supplements 89 Web (Mixed Mode) Supplements 91 Intergenerational Transfers 92 Intergenerational Transfers output_folder case_count 4 C:/Users/Matthew/Documents/PSID/family files/ NA 5 C:/Users/Matthew/Documents/PSID/family files/ NA 7 C:/Users/Matthew/Documents/PSID/family files/ NA 8 C:/Users/Matthew/Documents/PSID/family files/ NA 9 C:/Users/Matthew/Documents/PSID/family files/ NA 10 C:/Users/Matthew/Documents/PSID/family files/ NA 11 C:/Users/Matthew/Documents/PSID/family files/ NA 12 C:/Users/Matthew/Documents/PSID/family files/ NA 13 C:/Users/Matthew/Documents/PSID/family files/ NA 14 C:/Users/Matthew/Documents/PSID/family files/ NA 15 C:/Users/Matthew/Documents/PSID/family files/ NA 16 C:/Users/Matthew/Documents/PSID/family files/ NA 18 C:/Users/Matthew/Documents/PSID/family files/ NA 19 C:/Users/Matthew/Documents/PSID/family files/ NA 20 C:/Users/Matthew/Documents/PSID/family files/ NA 21 C:/Users/Matthew/Documents/PSID/family files/ NA 22 C:/Users/Matthew/Documents/PSID/family files/ NA 23 C:/Users/Matthew/Documents/PSID/wealth files/ NA 24 C:/Users/Matthew/Documents/PSID/family files/ NA 25 C:/Users/Matthew/Documents/PSID/family files/ NA 26 C:/Users/Matthew/Documents/PSID/family files/ NA 27 C:/Users/Matthew/Documents/PSID/family files/ NA 28 C:/Users/Matthew/Documents/PSID/family files/ NA 29 C:/Users/Matthew/Documents/PSID/wealth files/ NA 31 C:/Users/Matthew/Documents/PSID/family files/ NA 32 C:/Users/Matthew/Documents/PSID/family files/ NA 33 C:/Users/Matthew/Documents/PSID/family files/ NA 34 C:/Users/Matthew/Documents/PSID/family files/ NA 35 C:/Users/Matthew/Documents/PSID/family files/ NA 36 C:/Users/Matthew/Documents/PSID/wealth files/ NA 37 C:/Users/Matthew/Documents/PSID/family files/ NA 38 C:/Users/Matthew/Documents/PSID/family files/ NA 39 C:/Users/Matthew/Documents/PSID/family files/ NA 40 C:/Users/Matthew/Documents/PSID/family files/ NA 41 C:/Users/Matthew/Documents/PSID/wealth files/ NA 43 C:/Users/Matthew/Documents/PSID/family files/ NA 44 C:/Users/Matthew/Documents/PSID/wealth files/ NA 45 C:/Users/Matthew/Documents/PSID/family files/ NA 46 C:/Users/Matthew/Documents/PSID/wealth files/ NA 47 C:/Users/Matthew/Documents/PSID/family files/ NA 48 C:/Users/Matthew/Documents/PSID/wealth files/ NA 49 C:/Users/Matthew/Documents/PSID/family files/ NA 50 C:/Users/Matthew/Documents/PSID/wealth files/ NA 51 C:/Users/Matthew/Documents/PSID/family files/ NA 53 C:/Users/Matthew/Documents/PSID/family files/ NA 54 C:/Users/Matthew/Documents/PSID/family files/ NA 55 C:/Users/Matthew/Documents/PSID/family files/ NA 56 C:/Users/Matthew/Documents/PSID/family files/ NA 57 C:/Users/Matthew/Documents/PSID/family files/ NA 58 C:/Users/Matthew/Documents/PSID/family files/ NA 59 C:/Users/Matthew/Documents/PSID/family files/ NA 60 C:/Users/Matthew/Documents/PSID/family files/ NA 61 C:/Users/Matthew/Documents/PSID/family files/ NA 62 C:/Users/Matthew/Documents/PSID/family files/ NA 63 C:/Users/Matthew/Documents/PSID/family files/ NA 64 C:/Users/Matthew/Documents/PSID/family files/ NA 68 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 69 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 70 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 71 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 72 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 73 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 74 C:/Users/Matthew/Documents/PSID/child development supplement/ NA 76 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 77 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 78 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 79 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 80 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 81 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 82 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 83 C:/Users/Matthew/Documents/PSID/transition into adulthood supplement/ NA 85 C:/Users/Matthew/Documents/PSID/disability and use of time/ NA 86 C:/Users/Matthew/Documents/PSID/disability and use of time/ NA 88 C:/Users/Matthew/Documents/PSID/web mixed mode supplements/ NA 89 C:/Users/Matthew/Documents/PSID/web mixed mode supplements/ NA 91 C:/Users/Matthew/Documents/PSID/intergenerational transfers/ NA 92 C:/Users/Matthew/Documents/PSID/intergenerational transfers/ NA

ajdamico commented 10 months ago

hi! apologies for the long delay. i've made a couple of big updates to asdfree.com that hopefully make the website a bit better, but i've decided to stop maintaining the lodown package so probably won't fix the bug you've reported. the new asdfree doesn't have psid data yet, but it's on my to-do list. thanks