ajdamico / lodown

locally download and prepare publicly-available microdata
GNU General Public License v3.0
97 stars 47 forks source link

Failure: ACS, 2017, 5-Year #151

Closed Thirdhuman closed 9 months ago

Thirdhuman commented 5 years ago

Below is the requested info:

downloaded file size on disk (116269056) does not match server's content length (299770530) R version 3.5.3 (2019-03-11) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows >= 8 x64 (build 9200)

Matrix products: default

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252 LC_MONETARY=English_United States.1252 [4] LC_NUMERIC=C LC_TIME=English_United States.1252

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] lodown_0.1.0

loaded via a namespace (and not attached): [1] Rcpp_1.0.1 crayon_1.3.4 digest_0.6.18 R6_2.4.0 magrittr_1.5 pillar_1.3.1 httr_1.4.0 rlang_0.3.2
[9] stringi_1.4.3 curl_3.3 rstudioapi_0.10 xml2_1.2.0 forcats_0.4.0 tools_3.5.3 readr_1.3.1 stringr_1.4.0
[17] selectr_0.4-1 hms_0.4.2 yaml_2.2.0 compiler_3.5.3 pkgconfig_2.0.2 rvest_0.3.2 haven_2.1.0 tibble_2.1.1

lodown is now exiting unexpectedly. websites that host publicly-downloadable microdata change often and sometimes those changes cause this software to break. if the error call stack below appears to be a hiccup in your internet connection, then please verify your connectivity and retry the download. otherwise, please open a new issue at https://github.com/ajdamico/asdfree/issues with the contents of this error call stack and also the output of your sessionInfo().

[[1]] lodown("acs", acs_cat)

[[2]] withCallingHandlers(catalog <- load_fun(data_name = data_name, catalog, ...), error = function(e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } })

[[3]] load_fun(data_name = data_name, catalog, ...)

[[4]] cachaca(catalog[i, if (j == "h") "h_full_url" else "p_full_url"], tf, mode = "wb")

[[5]] stop(paste("download failed after", initial.attempts, "attempts"))

[[6]] .handleSimpleError(function (e) { print(sessionInfo()) if (grepl("cannot allocate vector of size", e)) message(memory_note) else if (grepl("parameter must be specified", e)) message(parameter_note) else if (grepl("to install", e)) message(installation_note) else { message(unknown_error_note) print(sys.calls()) } }, "download failed after 3 attempts", quote(cachaca(catalog[i, if (j == "h") "h_full_url" else "p_full_url"], tf, mode = "wb")))

[[7]] h(simpleError(msg, call))

Error in cachaca(catalog[i, if (j == "h") "h_full_url" else "p_full_url"], : download failed after 3 attempts In addition: Warning message: In (function (url, destfile, method, quiet = FALSE, mode = "w", : downloaded length 116269056 != reported length 299770530 year time_period stateab h_full_url 53 2017 5-Year al https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hal.zip 54 2017 5-Year ak https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hak.zip 55 2017 5-Year az https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_haz.zip 56 2017 5-Year ar https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_har.zip 57 2017 5-Year ca https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hca.zip 58 2017 5-Year co https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hco.zip 59 2017 5-Year ct https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hct.zip 60 2017 5-Year de https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hde.zip 61 2017 5-Year fl https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hfl.zip 62 2017 5-Year ga https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hga.zip 63 2017 5-Year hi https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hhi.zip 64 2017 5-Year id https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hid.zip 65 2017 5-Year il https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hil.zip 66 2017 5-Year in https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hin.zip 67 2017 5-Year ia https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hia.zip 68 2017 5-Year ks https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hks.zip 69 2017 5-Year ky https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hky.zip 70 2017 5-Year la https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hla.zip 71 2017 5-Year me https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hme.zip 72 2017 5-Year md https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hmd.zip 73 2017 5-Year ma https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hma.zip 74 2017 5-Year mi https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hmi.zip 75 2017 5-Year mn https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hmn.zip 76 2017 5-Year ms https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hms.zip 77 2017 5-Year mo https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hmo.zip 78 2017 5-Year mt https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hmt.zip 79 2017 5-Year ne https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hne.zip 80 2017 5-Year nv https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnv.zip 81 2017 5-Year nh https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnh.zip 82 2017 5-Year nj https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnj.zip 83 2017 5-Year nm https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnm.zip 84 2017 5-Year ny https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hny.zip 85 2017 5-Year nc https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnc.zip 86 2017 5-Year nd https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hnd.zip 87 2017 5-Year oh https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hoh.zip 88 2017 5-Year ok https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hok.zip 89 2017 5-Year or https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hor.zip 90 2017 5-Year pa https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hpa.zip 91 2017 5-Year ri https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hri.zip 92 2017 5-Year sc https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hsc.zip 93 2017 5-Year sd https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hsd.zip 94 2017 5-Year tn https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_htn.zip 95 2017 5-Year tx https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_htx.zip 96 2017 5-Year ut https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hut.zip 97 2017 5-Year vt https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hvt.zip 98 2017 5-Year va https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hva.zip 99 2017 5-Year wa https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hwa.zip 100 2017 5-Year wv https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hwv.zip 101 2017 5-Year wi https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hwi.zip 102 2017 5-Year wy https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hwy.zip 103 2017 5-Year dc https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hdc.zip 104 2017 5-Year pr https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_hpr.zip p_full_url merged_tablename 53 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pal.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 54 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pak.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 55 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_paz.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 56 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_par.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 57 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pca.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 58 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pco.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 59 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pct.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 60 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pde.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 61 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pfl.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 62 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pga.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 63 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_phi.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 64 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pid.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 65 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pil.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 66 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pin.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 67 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pia.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 68 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pks.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 69 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pky.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 70 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pla.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 71 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pme.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 72 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pmd.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 73 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pma.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 74 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pmi.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 75 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pmn.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 76 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pms.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 77 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pmo.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 78 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pmt.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 79 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pne.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 80 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnv.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 81 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnh.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 82 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnj.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 83 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnm.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 84 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pny.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 85 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnc.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 86 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pnd.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 87 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_poh.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 88 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pok.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 89 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_por.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 90 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_ppa.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 91 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pri.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 92 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_psc.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 93 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_psd.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 94 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_ptn.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 95 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_ptx.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 96 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_put.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 97 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pvt.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 98 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pva.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 99 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pwa.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 100 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pwv.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 101 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pwi.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 102 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pwy.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 103 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_pdc.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds 104 https://www2.census.gov/programs-surveys/acs/data/pums/2017/5-Year/csv_ppr.zip C:/Users/rober/Documents/ACS/acs2017_5yr.rds output_folder case_count 53 C:/Users/rober/Documents/ACS/2017/5-Year/ 238409 54 C:/Users/rober/Documents/ACS/2017/5-Year/ 33715 55 C:/Users/rober/Documents/ACS/2017/5-Year/ 336984 56 C:/Users/rober/Documents/ACS/2017/5-Year/ 148185 57 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 58 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 59 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 60 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 61 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 62 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 63 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 64 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 65 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 66 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 67 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 68 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 69 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 70 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 71 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 72 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 73 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 74 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 75 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 76 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 77 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 78 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 79 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 80 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 81 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 82 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 83 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 84 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 85 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 86 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 87 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 88 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 89 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 90 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 91 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 92 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 93 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 94 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 95 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 96 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 97 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 98 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 99 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 100 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 101 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 102 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 103 C:/Users/rober/Documents/ACS/2017/5-Year/ NA 104 C:/Users/rober/Documents/ACS/2017/5-Year/ NA

sessionInfo() R version 3.5.3 (2019-03-11) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows >= 8 x64 (build 9200)

Matrix products: default

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252 LC_MONETARY=English_United States.1252 [4] LC_NUMERIC=C LC_TIME=English_United States.1252

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] lodown_0.1.0

loaded via a namespace (and not attached): [1] Rcpp_1.0.1 crayon_1.3.4 digest_0.6.18 R6_2.4.0 magrittr_1.5 pillar_1.3.1 httr_1.4.0 rlang_0.3.2
[9] stringi_1.4.3 curl_3.3 rstudioapi_0.10 xml2_1.2.0 forcats_0.4.0 tools_3.5.3 readr_1.3.1 stringr_1.4.0
[17] selectr_0.4-1 hms_0.4.2 yaml_2.2.0 compiler_3.5.3 pkgconfig_2.0.2 rvest_0.3.2 haven_2.1.0 tibble_2.1.1

ajdamico commented 9 months ago

hi! apologies for the long delay. i've made a couple of big updates to asdfree.com that hopefully make the website a bit better, but i've decided to stop maintaining the lodown package so probably won't fix the bug you've reported. the new asdfree does have acs data, but only for the most current year. thanks