search

ajdamico / asdfree

analyze survey data for free
http://asdfree.com/
GNU General Public License v3.0
612 stars 449 forks source link

Error downloading CES #347

Closed ernietedeschi closed 10 months ago

ernietedeschi commented 5 years ago

Here's my sessionInfo() and error output:

R version 3.5.1 (2018-07-02)
Platform: x86_64-apple-darwin15.6.0 (64-bit)
Running under: macOS  10.14.3

Matrix products: default
BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/3.5/Resources/lib/libRlapack.dylib

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] usethis_1.4.0  devtools_2.0.1 lodown_0.1.0  

loaded via a namespace (and not attached):
 [1] Rcpp_1.0.0        cellranger_1.1.0  compiler_3.5.1    plyr_1.8.4        remotes_2.0.2     prettyunits_1.0.2 tools_3.5.1       testthat_2.0.1    digest_0.6.18    
[10] pkgbuild_1.0.2    pkgload_1.0.2     evaluate_0.13     memoise_1.1.0     rlang_0.3.1       cli_1.0.1         rstudioapi_0.9.0  curl_3.3          yaml_2.2.0       
[19] xfun_0.5          withr_2.1.2       httr_1.4.0        stringr_1.4.0     xml2_1.2.0        knitr_1.22        fs_1.2.6          desc_1.2.0        rprojroot_1.3-2  
[28] glue_1.3.0        R6_2.4.0          processx_3.2.1    readxl_1.3.0      rmarkdown_1.11    sessioninfo_1.1.1 reshape2_1.4.3    callr_3.1.1       selectr_0.4-1    
[37] magrittr_1.5      backports_1.1.3   ps_1.3.0          htmltools_0.3.6   assertthat_0.2.0  rvest_0.3.2       stringi_1.3.1     crayon_1.3.4 

[[1]]
lodown("ces", output_dir = file.path(path.expand("~/Documents/data/cex"), 
    "CES"))

[[2]]
withCallingHandlers(catalog <- load_fun(data_name = data_name, 
    catalog, ...), error = function(e) {
    print(sessionInfo())
    if (grepl("cannot allocate vector of size", e)) 
        message(memory_note)
    else if (grepl("parameter must be specified", e)) 
        message(parameter_note)
    else if (grepl("to install", e)) 
        message(installation_note)
    else {
        message(unknown_error_note)
        print(sys.calls())
    }
})

[[3]]
load_fun(data_name = data_name, catalog, ...)

[[4]]
census_thresholds()

[[5]]
httr::GET(this_excel, httr::write_disk(fn, overwrite = TRUE))

[[6]]
handle_url(handle, url, ...)

[[7]]
handle_find(url)

[[8]]
handle_name(url)

[[9]]
build_url(parse_url(url)[c("scheme", "hostname", "port")])

[[10]]
stopifnot(is.url(url))

[[11]]
withCallingHandlers(tryCatch(if (missE) ...elt(i) else eval(cl.i, 
    envir = envir), error = function(e) {
    e$call <- cl.i
    stop(e)
}), warning = function(w) {
    w$call <- cl.i
    w
})

[[12]]
tryCatch(if (missE) ...elt(i) else eval(cl.i, envir = envir), 
    error = function(e) {
        e$call <- cl.i
        stop(e)
    })

[[13]]
tryCatchList(expr, classes, parentenv, handlers)

[[14]]
tryCatchOne(expr, names, parentenv, handlers[[1L]])

[[15]]
value[[3L]](cond)

[[16]]
stop(e)

[[17]]
(function (e) 
{
    print(sessionInfo())
    if (grepl("cannot allocate vector of size", e)) 
        message(memory_note)
    else if (grepl("parameter must be specified", e)) 
        message(parameter_note)
    else if (grepl("to install", e)) 
        message(installation_note)
    else {
        message(unknown_error_note)
        print(sys.calls())
    }
})(list(message = "length(url) == 1 is not TRUE", call = is.url(url)))

Error in is.url(url) : length(url) == 1 is not TRUE
     type year                                              full_url                                     output_folder case_count
1  intrvw 2017 https://www.bls.gov//cex/pumd/data/stata/intrvw17.zip /Users/ernietedeschi/Documents/data/cex/CES/2017/         NA
2   diary 2017  https://www.bls.gov//cex/pumd/data/stata/diary17.zip /Users/ernietedeschi/Documents/data/cex/CES/2017/         NA
3  intrvw 2016 https://www.bls.gov//cex/pumd/data/stata/intrvw16.zip /Users/ernietedeschi/Documents/data/cex/CES/2016/         NA
4   diary 2016  https://www.bls.gov//cex/pumd/data/stata/diary16.zip /Users/ernietedeschi/Documents/data/cex/CES/2016/         NA
5  intrvw 2015 https://www.bls.gov//cex/pumd/data/stata/intrvw15.zip /Users/ernietedeschi/Documents/data/cex/CES/2015/         NA
6   diary 2015  https://www.bls.gov//cex/pumd/data/stata/diary15.zip /Users/ernietedeschi/Documents/data/cex/CES/2015/         NA
7  intrvw 2014 https://www.bls.gov//cex/pumd/data/stata/intrvw14.zip /Users/ernietedeschi/Documents/data/cex/CES/2014/         NA
8   diary 2014  https://www.bls.gov//cex/pumd/data/stata/diary14.zip /Users/ernietedeschi/Documents/data/cex/CES/2014/         NA
9  intrvw 2013 https://www.bls.gov//cex/pumd/data/stata/intrvw13.zip /Users/ernietedeschi/Documents/data/cex/CES/2013/         NA
10  diary 2013  https://www.bls.gov//cex/pumd/data/stata/diary13.zip /Users/ernietedeschi/Documents/data/cex/CES/2013/         NA
11 intrvw 2012 https://www.bls.gov//cex/pumd/data/stata/intrvw12.zip /Users/ernietedeschi/Documents/data/cex/CES/2012/         NA
12  diary 2012  https://www.bls.gov//cex/pumd/data/stata/diary12.zip /Users/ernietedeschi/Documents/data/cex/CES/2012/         NA
13 intrvw 2011 https://www.bls.gov//cex/pumd/data/stata/intrvw11.zip /Users/ernietedeschi/Documents/data/cex/CES/2011/         NA
14  diary 2011  https://www.bls.gov//cex/pumd/data/stata/diary11.zip /Users/ernietedeschi/Documents/data/cex/CES/2011/         NA
15 intrvw 2010 https://www.bls.gov//cex/pumd/data/stata/intrvw10.zip /Users/ernietedeschi/Documents/data/cex/CES/2010/         NA
16  diary 2010  https://www.bls.gov//cex/pumd/data/stata/diary10.zip /Users/ernietedeschi/Documents/data/cex/CES/2010/         NA
17 intrvw 2009 https://www.bls.gov//cex/pumd/data/stata/intrvw09.zip /Users/ernietedeschi/Documents/data/cex/CES/2009/         NA
18  diary 2009  https://www.bls.gov//cex/pumd/data/stata/diary09.zip /Users/ernietedeschi/Documents/data/cex/CES/2009/         NA
19 intrvw 2008 https://www.bls.gov//cex/pumd/data/stata/intrvw08.zip /Users/ernietedeschi/Documents/data/cex/CES/2008/         NA
20  diary 2008  https://www.bls.gov//cex/pumd/data/stata/diary08.zip /Users/ernietedeschi/Documents/data/cex/CES/2008/         NA
21 intrvw 2007 https://www.bls.gov//cex/pumd/data/stata/intrvw07.zip /Users/ernietedeschi/Documents/data/cex/CES/2007/         NA
22  diary 2007  https://www.bls.gov//cex/pumd/data/stata/diary07.zip /Users/ernietedeschi/Documents/data/cex/CES/2007/         NA
23 intrvw 2006 https://www.bls.gov//cex/pumd/data/stata/intrvw06.zip /Users/ernietedeschi/Documents/data/cex/CES/2006/         NA
24  diary 2006  https://www.bls.gov//cex/pumd/data/stata/diary06.zip /Users/ernietedeschi/Documents/data/cex/CES/2006/         NA
25 intrvw 2005 https://www.bls.gov//cex/pumd/data/stata/intrvw05.zip /Users/ernietedeschi/Documents/data/cex/CES/2005/         NA
26  diary 2005  https://www.bls.gov//cex/pumd/data/stata/diary05.zip /Users/ernietedeschi/Documents/data/cex/CES/2005/         NA
27 intrvw 2004 https://www.bls.gov//cex/pumd/data/stata/intrvw04.zip /Users/ernietedeschi/Documents/data/cex/CES/2004/         NA
28  diary 2004  https://www.bls.gov//cex/pumd/data/stata/diary04.zip /Users/ernietedeschi/Documents/data/cex/CES/2004/         NA
29 intrvw 2003 https://www.bls.gov//cex/pumd/data/stata/intrvw03.zip /Users/ernietedeschi/Documents/data/cex/CES/2003/         NA
30  diary 2003  https://www.bls.gov//cex/pumd/data/stata/diary03.zip /Users/ernietedeschi/Documents/data/cex/CES/2003/         NA
31 intrvw 2002 https://www.bls.gov//cex/pumd/data/stata/intrvw02.zip /Users/ernietedeschi/Documents/data/cex/CES/2002/         NA
32  diary 2002  https://www.bls.gov//cex/pumd/data/stata/diary02.zip /Users/ernietedeschi/Documents/data/cex/CES/2002/         NA
33 intrvw 2001 https://www.bls.gov//cex/pumd/data/stata/intrvw01.zip /Users/ernietedeschi/Documents/data/cex/CES/2001/         NA
34  diary 2001  https://www.bls.gov//cex/pumd/data/stata/diary01.zip /Users/ernietedeschi/Documents/data/cex/CES/2001/         NA
35 intrvw 2000 https://www.bls.gov//cex/pumd/data/stata/intrvw00.zip /Users/ernietedeschi/Documents/data/cex/CES/2000/         NA
36  diary 2000  https://www.bls.gov//cex/pumd/data/stata/diary00.zip /Users/ernietedeschi/Documents/data/cex/CES/2000/         NA
37 intrvw 1999 https://www.bls.gov//cex/pumd/data/stata/intrvw99.zip /Users/ernietedeschi/Documents/data/cex/CES/1999/         NA
38  diary 1999  https://www.bls.gov//cex/pumd/data/stata/diary99.zip /Users/ernietedeschi/Documents/data/cex/CES/1999/         NA
39 intrvw 1998 https://www.bls.gov//cex/pumd/data/stata/intrvw98.zip /Users/ernietedeschi/Documents/data/cex/CES/1998/         NA
40  diary 1998  https://www.bls.gov//cex/pumd/data/stata/diary98.zip /Users/ernietedeschi/Documents/data/cex/CES/1998/         NA
41 intrvw 1997 https://www.bls.gov//cex/pumd/data/stata/intrvw97.zip /Users/ernietedeschi/Documents/data/cex/CES/1997/         NA
42  diary 1997  https://www.bls.gov//cex/pumd/data/stata/diary97.zip /Users/ernietedeschi/Documents/data/cex/CES/1997/         NA
43 intrvw 1996 https://www.bls.gov//cex/pumd/data/stata/intrvw96.zip /Users/ernietedeschi/Documents/data/cex/CES/1996/         NA
44  diary 1996  https://www.bls.gov//cex/pumd/data/stata/diary96.zip /Users/ernietedeschi/Documents/data/cex/CES/1996/         NA
ajdamico commented 10 months ago

hi! apologies for the long delay. i've made a couple of big updates to asdfree.com that hopefully make the website a bit better, but i've decided to stop maintaining the lodown package so probably won't fix the bug you've reported. the new asdfree does have ces data, but only for the most current year. thanks