fdetsch / MODIS

Download and processing framework for MODIS imagery. The package provides automated access to the global online data archives LP DAAC, LAADS and NSIDC as well as processing capabilities such as file conversion, mosaicking, subsetting and time series.
Other
58 stars 27 forks source link

Error while downloading MOD13Q1 files #89

Closed bethdelaney closed 4 years ago

bethdelaney commented 4 years ago

Hi I was wondering if someone could help me figure out why I'm getting the following issue.

I'm attempting to use getHdf to download MOD13Q1 data to do some NDVI analysis but am receiving the following error message once I get to a specific date (after 2020-12-03):

Error in if (ftpfiles[1] == FALSE) { : missing value where TRUE/FALSE needed

My code is:

product<- "MOD13Q1"
tileH<-17
tileV<-3
begin<-"2001-01-01"
end<-"2020-04-22"

modis.hdf<-getHdf(product = product, begin = begin, end = end, tileH = tileH, tileV = tileV, checkIntegrity = TRUE)

I've tried changing the dates to see if the problem is hdf 2020-12-19 but it doesn't appear to be. As you can probably tell I'm still new to coding and so please feel free to be as condescending as you may need to be to help me! Many thanks in advance.

fdetsch commented 4 years ago

Absolutely no need for condescendence. Your code works on my end. Can you please provide the output of sessionInfo()?

bethdelaney commented 4 years ago

Thank you! No problem - see below.

`> sessionInfo() R version 3.6.1 (2019-07-05) Platform: x86_64-apple-darwin15.6.0 (64-bit) Running under: macOS Catalina 10.15.4

Matrix products: default BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib LAPACK: /Library/Frameworks/R.framework/Versions/3.6/Resources/lib/libRlapack.dylib

locale: [1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] rgeos_0.5-2 rgdal_1.4-8 MODIS_1.1.7 raster_3.1-5 sp_1.4-1 mapdata_2.3.0 maps_3.3.0 MODISTools_1.1.1

loaded via a namespace (and not attached): [1] remotes_2.1.1 sf_0.9-2 lattice_0.20-38 testthat_2.3.2 usethis_1.6.0 htmltools_0.4.0 rlang_0.4.5 pkgbuild_1.0.6
[9] e1071_1.7-2 nloptr_1.2.1 later_1.0.0 foreign_0.8-71 glue_1.4.0 withr_2.1.2 DBI_1.0.0 sessioninfo_1.1.1 [17] mapedit_0.6.0 devtools_2.3.0 codetools_0.2-16 memoise_1.1.0 callr_3.4.3 fastmap_1.0.1 httpuv_1.5.2 ps_1.3.2
[25] maptools_0.9-9 class_7.3-15 parallel_3.6.1 curl_4.2 fansi_0.4.0 Rcpp_1.0.2 KernSmooth_2.23-15 xtable_1.8-4
[33] backports_1.1.5 promises_1.1.0 classInt_0.4-2 desc_1.2.0 pkgload_1.0.2 mime_0.7 fs_1.4.1 ptw_1.9-15
[41] digest_0.6.25 processx_3.4.2 shiny_1.4.0.2 grid_3.6.1 rprojroot_1.3-2 cli_2.0.2 tools_3.6.1 bitops_1.0-6
[49] magrittr_1.5 crayon_1.3.4 ellipsis_0.3.0 Matrix_1.2-17 prettyunits_1.1.0 assertthat_0.2.1 rstudioapi_0.11 R6_2.4.0
[57] units_0.6-5 compiler_3.6.1 `

fdetsch commented 4 years ago

I really need a macOS testing environment.. 🤔

Until then, does it work if you set the end date to just before the error occurs?

bethdelaney commented 4 years ago

I'm beginning to think that R just needed a good night's sleep as I've tried it again this morning and success!

I had been fiddling with the dates and changing it to 1-year periods at a time, to see whether it was the sheer amount of data being requested that was causing the problem. I thought I'd give the full code a go one more time and it's working - I'm not sure what the issue must have been but thank you for having a go anyway!

fdetsch commented 4 years ago

Glad to hear it works! For the record, simply omitting the end date will result in getHdf() downloading all MOD13Q1 files up to the most recent one. The current file inventory is available here.