fdetsch / MODIS

Download and processing framework for MODIS imagery. The package provides automated access to the global online data archives LP DAAC, LAADS and NSIDC as well as processing capabilities such as file conversion, mosaicking, subsetting and time series.
Other
58 stars 27 forks source link

Download error, "Remote connection failed" #44

Closed gregor-d closed 6 years ago

gregor-d commented 6 years ago

I get connection errors when I try to excute runGdal. It worked fine just 3 weeks ago. I tried with CRAN version and Developer Version of MODIS on two different PCs using two different Earthdata-accounts, both working on the homepage. Is this a problem with me, the package or the MODIS-servers?

This is the error message:

> runGdal( product="MOD11A1", extent="austria", begin="2010001", end="2010005", SDSstring="101")
No collection specified, getting the newest for MOD11A1 
########################
outProj          =  asIn 
pixelSize        =  asIn 
resamplingType   =  near 
Output directory =  C:/Users/2550k/Google Drive/data/modis/processed//MOD11A1.006_20180407153326  (no 'job' name specified, generated (date/time based))
########################
Local structure is up-to-date. Using offline information!

Getting file from: LPDAAC 
############################
Remote connection failed! Re-try: 1 
Getting file from: LAADS 
############################
trying URL 'ftp://ladsweb.nascom.nasa.gov/allData/6/MOD11A1/2010/001/MOD11A1.A2010001.h19v04.006.2016025150413.hdf'
Remote connection failed! Re-try: 2 
Getting file from: LPDAAC 
############################
Remote connection failed! Re-try: 3 
...

If I try the other example provided in the runGdal help, I get this error

> runGdal( product="MOD11A1", begin="2010001", end="2010005", SDSstring="101")
No collection specified, getting the newest for MOD11A1 
Loading required namespace: leaflet.extras
Loading required namespace: miniUI
Loading required package: shiny

Listening on http://127.0.0.1:3657
########################
outProj          =  +proj=longlat +datum=WGS84 +no_defs +ellps=WGS84 +towgs84=0,0,0  (derived from Raster*/Spatial* object)
pixelSize        =  asIn 
resamplingType   =  near 
Output directory =  C:/Users/2550k/AppData/Local/Temp/RtmpIDKJbR/MODIS_ARC/PROCESSED//MOD11A1.006_20180407155410  (no 'job' name specified, generated (date/time based))
########################
Downloading structure on 'LAADS' for: MOD11A1.006
Error in if (FtpDayDirs[1] == FALSE) { :                                 
  missing value where TRUE/FALSE needed

My Sessioninfo and MODIS-options

> sessionInfo()
R version 3.4.4 (2018-03-15)
Platform: x86_64-w64-mingw32/x64 (64-bit)
Running under: Windows >= 8 x64 (build 9200)

Matrix products: default

locale:
[1] LC_COLLATE=English_Canada.1252  LC_CTYPE=English_Canada.1252    LC_MONETARY=English_Canada.1252
[4] LC_NUMERIC=C                    LC_TIME=English_Canada.1252    

attached base packages:
[1] stats     graphics  grDevices utils     datasets  methods   base     

other attached packages:
[1] MODIS_1.1.3   raster_2.6-7  sp_1.2-7      mapdata_2.3.0 maps_3.3.0   

loaded via a namespace (and not attached):
 [1] Rcpp_0.12.16    magrittr_1.5    units_0.5-1     maptools_0.9-2  devtools_1.13.5 xtable_1.8-2    lattice_0.20-35
 [8] R6_2.2.2        ptw_1.9-12      udunits2_0.13   tools_3.4.4     parallel_3.4.4  rgdal_1.2-18    grid_3.4.4     
[15] e1071_1.6-8     DBI_0.8         withr_2.1.2     class_7.3-14    rgeos_0.3-26    htmltools_0.3.6 mapedit_0.4.1  
[22] digest_0.6.15   sf_0.6-1        shiny_1.0.5     nloptr_1.0.4    bitops_1.0-6    RCurl_1.95-4.10 memoise_1.1.0  
[29] mime_0.5        compiler_3.4.4  classInt_0.1-24 XML_3.98-1.10   foreign_0.8-69  httpuv_1.3.6.2 `
>MODISoptions()
  'MRT_HOME' not set/found! MRT is NOT enabled! See: 'https://lpdaac.usgs.gov/tools/modis_reprojection_tool'

STORAGE:
_______________
localArcPath : C:/Users/2550k/Google Drive/data/modis/ 
outDirPath   : C:/Users/2550k/Google Drive/data/modis/processed/ 

DOWNLOAD:
_______________
MODISserverOrder :  LAADS, LPDAAC 
dlmethod         : auto 
stubbornness     : high 
wait             : 0.2 
quiet            : FALSE 

PROCESSING:
_______________
GDAL           : GDAL 2.2.4, released 2018/03/19 
MRT            : Not available. Use 'MODIS:::checkTools('MRT')' for more information! 
pixelSize      : asIn 
outProj        : asIn 
resamplingType : NN 
dataFormat     : GTiff 
rrushi commented 6 years ago

I had the similar issue with rungdal.

sessionInfo() R version 3.4.4 (2018-03-15) Platform: x86_64-w64-mingw32/x64 (64-bit) Running under: Windows 7 x64 (build 7601) Service Pack 1

Matrix products: default

locale: [1] LC_COLLATE=English_United States.1252 LC_CTYPE=English_United States.1252
[3] LC_MONETARY=English_United States.1252 LC_NUMERIC=C
[5] LC_TIME=English_United States.1252

attached base packages: [1] stats graphics grDevices utils datasets methods base

other attached packages: [1] rgdal_1.2-18 gdalUtils_2.0.1.7 MODIS_1.1.3 mapdata_2.3.0 maps_3.3.0 rts_1.0-45
[7] RCurl_1.95-4.10 bitops_1.0-6 xts_0.10-2 zoo_1.8-1 raster_2.6-7 sp_1.2-7
[13] optparse_1.4.4

loaded via a namespace (and not attached): [1] Rcpp_0.12.16 git2r_0.21.0 compiler_3.4.4 nloptr_1.0.4 R.methodsS3_1.7.1 R.utils_2.6.0
[7] iterators_1.0.9 class_7.3-14 tools_3.4.4 digest_0.6.15 jsonlite_1.5 memoise_1.1.0
[13] lattice_0.20-35 foreach_1.4.4 shiny_1.0.5 DBI_0.8 curl_3.2 yaml_2.1.18
[19] parallel_3.4.4 e1071_1.6-8 httr_1.3.1 withr_2.1.2 rgeos_0.3-26 devtools_1.13.5
[25] classInt_0.1-24 mapedit_0.4.1 grid_3.4.4 getopt_1.20.2 sf_0.6-1 R6_2.2.2
[31] ptw_1.9-12 XML_3.98-1.10 foreign_0.8-69 udunits2_0.13 magrittr_1.5 codetools_0.2-15 [37] units_0.5-1 htmltools_0.3.6 maptools_0.9-2 mime_0.5 xtable_1.8-2 httpuv_1.3.6.2
[43] R.oo_1.21.0

gregor-d commented 6 years ago

For me It is working. The LPDDAC server still gives a connection error, but the download over LAADS is working fine (for now)

rrushi commented 6 years ago

It's working fine now.

WillemVervoort commented 6 years ago

I am afraid it is still not working for me. LAADS is indeed working, but they don't seem to have access to MOD16A2, which I am after. LPDAAC is still giving a connection error.