chrisvwn / Rnightlights

R package to extract data from satellite nightlights.
GNU General Public License v3.0
47 stars 14 forks source link

Error in gdal_chooseInstallation #49

Closed calvinke closed 4 years ago

calvinke commented 4 years ago

Sorry I have run into another error: ctry <- "IND" getnldata_VIIRS<-getCtryNlData(ctryCode="IND", admLevel="adm0", custPolyPath="C://Users/Documents/Data/alan/India.zip", nlType="VIIRS.Y", nlPeriods="2015", nlStats="sum", ignoreMissing=FALSE) ...

2019-12-10 20:06:12: gdalwarp masking to VRT Error in gdal_chooseInstallation(hasDrivers = of) : No installations match. In addition: Warning message: In RGEOSBinPredFunc(spgeom1, spgeom2, byid, func) : spgeom1 and spgeom2 have different proj4 strings

I did install the "gdalUtils" package. Do you know what the problem might be?

chrisvwn commented 4 years ago

Hi,

This seems be related to the gdal not being in the path so that the package cannot find it.

Could you share the instructions you used to install gdal.

Alternatively, if you have just installed it do make sure to restart rstudio/R so that it can get a fresh copy of the environment variables (This might also be the situation we encountered with aria?).

If all else fails, try setting the pkgOptions cropMaskMethod='rast' and extractMethod='rast' to disable the use of gdal.

calvinke commented 4 years ago

You were right about the installation problem - I previously installed gdal using this program: https://trac.osgeo.org/osgeo4w/wiki . I guess that only installs gdal within the OSGeo4W shell. So instead I tried using these directions: https://sandbox.idre.ucla.edu/sandbox/tutorials/installing-gdal-for-windows and now I think GDAL is installed properly. I restarted R, restarted my computer even, however, I still get the same error. I verified that GDAL is installed:

2019-12-12 00:11:24: gdalwarp masking to VRT
Error in gdal_chooseInstallation(hasDrivers = of) : 
  No installations match.
In addition: Warning message:
In RGEOSBinPredFunc(spgeom1, spgeom2, byid, func) :
  spgeom1 and spgeom2 have different proj4 strings
> gdal_setInstallation()
> getOption("gdalUtils_gdalPath")
[[1]]
[[1]]$path
[1] "C:/PROGRA~1/GDAL/"

[[1]]$version
version 
"3.0.0" 

[[1]]$date
        date 
"2019-05-05" 

[[1]]$drivers
                    format_code read write update virtualIO subdatasets
1                   BAG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
2                  FITS-raster- TRUE  TRUE   TRUE     FALSE       FALSE
3                   GMT-raster- TRUE  TRUE  FALSE     FALSE       FALSE
4                  HDF4-raster- TRUE FALSE  FALSE     FALSE        TRUE
5             HDF4Image-raster- TRUE  TRUE   TRUE     FALSE       FALSE
6                  HDF5-raster- TRUE FALSE  FALSE      TRUE        TRUE
7             HDF5Image-raster- TRUE FALSE  FALSE      TRUE       FALSE
8                   KEA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
9         netCDF-raster,vector- TRUE  TRUE   TRUE     FALSE        TRUE
10                  VRT-raster- TRUE  TRUE   TRUE      TRUE       FALSE
11              DERIVED-raster- TRUE FALSE  FALSE     FALSE       FALSE
12                GTiff-raster- TRUE  TRUE   TRUE      TRUE        TRUE
13                 NITF-raster- TRUE  TRUE   TRUE      TRUE        TRUE
14               RPFTOC-raster- TRUE FALSE  FALSE      TRUE        TRUE
15              ECRGTOC-raster- TRUE FALSE  FALSE      TRUE        TRUE
16                  HFA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
17             SAR_CEOS-raster- TRUE FALSE  FALSE      TRUE       FALSE
18                 CEOS-raster- TRUE FALSE  FALSE      TRUE       FALSE
19           JAXAPALSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
20                  GFF-raster- TRUE FALSE  FALSE      TRUE       FALSE
21                 ELAS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
22                  AIG-raster- TRUE FALSE  FALSE      TRUE       FALSE
23              AAIGrid-raster- TRUE  TRUE  FALSE      TRUE       FALSE
24       GRASSASCIIGrid-raster- TRUE FALSE  FALSE      TRUE       FALSE
25                 SDTS-raster- TRUE FALSE  FALSE      TRUE       FALSE
26                 DTED-raster- TRUE  TRUE  FALSE      TRUE       FALSE
27                  PNG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
28                 JPEG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
29                  MEM-raster- TRUE  TRUE   TRUE     FALSE       FALSE
30                 JDEM-raster- TRUE FALSE  FALSE      TRUE       FALSE
31                  GIF-raster- TRUE  TRUE  FALSE      TRUE       FALSE
32               BIGGIF-raster- TRUE FALSE  FALSE      TRUE       FALSE
33                 ESAT-raster- TRUE FALSE  FALSE      TRUE       FALSE
34                  BSB-raster- TRUE FALSE  FALSE      TRUE       FALSE
35                  XPM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
36                  BMP-raster- TRUE  TRUE   TRUE      TRUE       FALSE
37                DIMAP-raster- TRUE FALSE  FALSE      TRUE       FALSE
38               AirSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
39                  RS2-raster- TRUE FALSE  FALSE      TRUE        TRUE
40                 SAFE-raster- TRUE FALSE  FALSE      TRUE       FALSE
41        PCIDSK-raster,vector- TRUE  TRUE   TRUE      TRUE       FALSE
42             PCRaster-raster- TRUE  TRUE   TRUE     FALSE       FALSE
43                ILWIS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
44                  SGI-raster- TRUE  TRUE   TRUE      TRUE       FALSE
45              SRTMHGT-raster- TRUE  TRUE  FALSE      TRUE       FALSE
46             Leveller-raster- TRUE  TRUE   TRUE      TRUE       FALSE
47             Terragen-raster- TRUE  TRUE   TRUE      TRUE       FALSE
48                ISIS3-raster- TRUE  TRUE   TRUE      TRUE       FALSE
49                ISIS2-raster- TRUE  TRUE   TRUE      TRUE       FALSE
50                  PDS-raster- TRUE FALSE  FALSE      TRUE       FALSE
51          PDS4-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
52                VICAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
53                  TIL-raster- TRUE FALSE  FALSE      TRUE       FALSE
54                  ERS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
55   JP2OpenJPEG-raster,vector- TRUE  TRUE  FALSE      TRUE       FALSE
56                  L1B-raster- TRUE FALSE  FALSE      TRUE        TRUE
57                  FIT-raster- TRUE  TRUE  FALSE      TRUE       FALSE
58                 GRIB-raster- TRUE  TRUE  FALSE      TRUE       FALSE
59                  RMF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
60                  WCS-raster- TRUE FALSE  FALSE      TRUE        TRUE
61                  WMS-raster- TRUE  TRUE  FALSE      TRUE        TRUE
62                 MSGN-raster- TRUE FALSE  FALSE      TRUE       FALSE
63                  RST-raster- TRUE  TRUE   TRUE      TRUE       FALSE
64                 INGR-raster- TRUE  TRUE   TRUE      TRUE       FALSE
65                 GSAG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
66                 GSBG-raster- TRUE  TRUE   TRUE      TRUE       FALSE
67                GS7BG-raster- TRUE  TRUE   TRUE      TRUE       FALSE
68                COSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
69                  TSX-raster- TRUE FALSE  FALSE      TRUE       FALSE
70                COASP-raster- TRUE FALSE  FALSE     FALSE       FALSE
71                    R-raster- TRUE  TRUE  FALSE      TRUE       FALSE
72                  MAP-raster- TRUE FALSE  FALSE      TRUE       FALSE
73      KMLSUPEROVERLAY-raster- TRUE  TRUE  FALSE      TRUE       FALSE
74           PDF-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
75           Rasterlite-raster- TRUE  TRUE  FALSE      TRUE        TRUE
76       MBTiles-raster,vector- TRUE  TRUE   TRUE      TRUE       FALSE
77             PLMOSAIC-raster- TRUE FALSE  FALSE     FALSE       FALSE
78                 CALS-raster- TRUE  TRUE  FALSE      TRUE       FALSE
79                 WMTS-raster- TRUE  TRUE  FALSE      TRUE       FALSE
80            SENTINEL2-raster- TRUE FALSE  FALSE      TRUE        TRUE
81                  MRF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
82                  PNM-raster- TRUE  TRUE   TRUE      TRUE       FALSE
83                 DOQ1-raster- TRUE FALSE  FALSE      TRUE       FALSE
84                 DOQ2-raster- TRUE FALSE  FALSE      TRUE       FALSE
85                 PAux-raster- TRUE  TRUE   TRUE      TRUE       FALSE
86                  MFF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
87                 MFF2-raster- TRUE  TRUE   TRUE     FALSE       FALSE
88              FujiBAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
89                  GSC-raster- TRUE FALSE  FALSE      TRUE       FALSE
90                 FAST-raster- TRUE FALSE  FALSE      TRUE       FALSE
91                   BT-raster- TRUE  TRUE   TRUE      TRUE       FALSE
92                  LAN-raster- TRUE  TRUE   TRUE      TRUE       FALSE
93                  CPG-raster- TRUE FALSE  FALSE      TRUE       FALSE
94                  IDA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
95                  NDF-raster- TRUE FALSE  FALSE      TRUE       FALSE
96                  EIR-raster- TRUE FALSE  FALSE      TRUE       FALSE
97                DIPEx-raster- TRUE FALSE  FALSE      TRUE       FALSE
98                  LCP-raster- TRUE  TRUE  FALSE      TRUE       FALSE
99                  GTX-raster- TRUE  TRUE   TRUE      TRUE       FALSE
100              LOSLAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
101                NTv1-raster- TRUE FALSE  FALSE      TRUE       FALSE
102                NTv2-raster- TRUE  TRUE   TRUE      TRUE        TRUE
103             CTable2-raster- TRUE  TRUE   TRUE      TRUE       FALSE
104                ACE2-raster- TRUE FALSE  FALSE      TRUE       FALSE
105              SNODAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
106                 KRO-raster- TRUE  TRUE   TRUE      TRUE       FALSE
107             ROI_PAC-raster- TRUE  TRUE   TRUE      TRUE       FALSE
108             RRASTER-raster- TRUE  TRUE   TRUE      TRUE       FALSE
109                 BYN-raster- TRUE  TRUE   TRUE      TRUE       FALSE
110                 ARG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
111                 RIK-raster- TRUE FALSE  FALSE      TRUE       FALSE
112             USGSDEM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
113                 GXF-raster- TRUE FALSE  FALSE      TRUE       FALSE
114             NWT_GRD-raster- TRUE  TRUE   TRUE      TRUE       FALSE
115             NWT_GRC-raster- TRUE FALSE  FALSE      TRUE       FALSE
116                ADRG-raster- TRUE  TRUE   TRUE      TRUE        TRUE
117                 SRP-raster- TRUE FALSE  FALSE      TRUE        TRUE
118                 BLX-raster- TRUE  TRUE  FALSE      TRUE       FALSE
119       PostGISRaster-raster- TRUE  TRUE  FALSE     FALSE        TRUE
120                SAGA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
121 IGNFHeightASCIIGrid-raster- TRUE FALSE  FALSE      TRUE       FALSE
122                 XYZ-raster- TRUE  TRUE  FALSE      TRUE       FALSE
123                 HF2-raster- TRUE  TRUE  FALSE      TRUE       FALSE
124                 OZI-raster- TRUE FALSE  FALSE      TRUE       FALSE
125                 CTG-raster- TRUE FALSE  FALSE      TRUE       FALSE
126             E00GRID-raster- TRUE FALSE  FALSE      TRUE       FALSE
127                ZMap-raster- TRUE  TRUE  FALSE      TRUE       FALSE
128            NGSGEOID-raster- TRUE FALSE  FALSE      TRUE       FALSE
129                IRIS-raster- TRUE FALSE  FALSE      TRUE       FALSE
130                 PRF-raster- TRUE FALSE  FALSE      TRUE       FALSE
131                 RDA-raster- TRUE FALSE  FALSE     FALSE       FALSE
132               EEDAI-raster- TRUE FALSE  FALSE     FALSE        TRUE
133                DAAS-raster- TRUE FALSE  FALSE     FALSE       FALSE
134              SIGDEM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
135      DB2ODBC-raster,vector- TRUE  TRUE   TRUE     FALSE       FALSE
136         GPKG-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
137          CAD-raster,vector- TRUE FALSE  FALSE      TRUE        TRUE
138     PLSCENES-raster,vector- TRUE FALSE  FALSE     FALSE       FALSE
139          NGW-raster,vector- TRUE  TRUE   TRUE     FALSE        TRUE
140              GenBin-raster- TRUE FALSE  FALSE      TRUE       FALSE
141                ENVI-raster- TRUE  TRUE   TRUE      TRUE       FALSE
142                EHdr-raster- TRUE  TRUE   TRUE      TRUE       FALSE
                                                 format_name
1                                 Bathymetry Attributed Grid
2                            Flexible Image Transport System
3                                     GMT NetCDF Grid Format
4                         Hierarchical Data Format Release 4
5                                               HDF4 Dataset
6                         Hierarchical Data Format Release 5
7                                               HDF5 Dataset
8                                    KEA Image Format (.kea)
9                                 Network Common Data Format
10                                            Virtual Raster
11                Derived datasets using VRT pixel functions
12                                                   GeoTIFF
13                      National Imagery Transmission Format
14                          Raster Product Format TOC format
15                                           ECRG TOC format
16                               Erdas Imagine Images (.img)
17                                            CEOS SAR Image
18                                                CEOS Image
19                JAXA PALSAR Product Reader (Level 1.1/1.5)
20  Ground-based SAR Applications Testbed File Format (.gff)
21                                                      ELAS
22                                      Arc/Info Binary Grid
23                                       Arc/Info ASCII Grid
24                                          GRASS ASCII Grid
25                                               SDTS Raster
26                                     DTED Elevation Raster
27                                 Portable Network Graphics
28                                                 JPEG JFIF
29                                          In Memory Raster
30                                       Japanese DEM (.mem)
31                        Graphics Interchange Format (.gif)
32                        Graphics Interchange Format (.gif)
33                                      Envisat Image Format
34                               Maptech BSB Nautical Charts
35                                         X11 PixMap Format
36                      MS Windows Device Independent Bitmap
37                                                SPOT DIMAP
38                                 AirSAR Polarimetric Image
39                                    RadarSat 2 XML Product
40                               Sentinel-1 SAR SAFE Product
41                                      PCIDSK Database File
42                                      PCRaster Raster File
43                                          ILWIS Raster Map
44                                 SGI Image File Format 1.0
45                                       SRTMHGT File Format
46                                      Leveller heightfield
47                                      Terragen heightfield
48                   USGS Astrogeology ISIS cube (Version 3)
49                   USGS Astrogeology ISIS cube (Version 2)
50                                NASA Planetary Data System
51                              NASA Planetary Data System 4
52                                           MIPL VICAR file
53                                           EarthWatch .TIL
54                                    ERMapper .ers Labelled
55                JPEG-2000 driver based on OpenJPEG library
56                      NOAA Polar Orbiter Level 1b Data Set
57                                                 FIT Image
58                              GRIdded Binary (.grb, .grb2)
59                                      Raster Matrix Format
60                                  OGC Web Coverage Service
61                                       OGC Web Map Service
62                            EUMETSAT Archive native (.nat)
63                                         Idrisi Raster A.1
64                                         Intergraph Raster
65                         Golden Software ASCII Grid (.grd)
66                        Golden Software Binary Grid (.grd)
67                      Golden Software 7 Binary Grid (.grd)
68                COSAR Annotated Binary Matrix (TerraSAR-X)
69                                        TerraSAR-X Product
70                           DRDC COASP SAR Processor Raster
71                                       R Object Data Store
72                                          OziExplorer .MAP
73                                         Kml Super Overlay
74                                            Geospatial PDF
75                                                Rasterlite
76                                                   MBTiles
77                                   Planet Labs Mosaics API
78                                             CALS (Type 1)
79                                  OGC Web Map Tile Service
80                                                Sentinel 2
81                                        Meta Raster Format
82                           Portable Pixmap Format (netpbm)
83                                      USGS DOQ (Old Style)
84                                      USGS DOQ (New Style)
85                                         PCI .aux Labelled
86                                         Vexcel MFF Raster
87                                  Vexcel MFF2 (HKV) Raster
88                                    Fuji BAS Scanner Image
89                                               GSC Geogrid
90                                         EOSAT FAST Format
91                       VTP .bt (Binary Terrain) 1.3 Format
92                                           Erdas .LAN/.GIS
93                                           Convair PolGASP
94                                   Image Data and Analysis
95                                         NLAPS Data Format
96                                         Erdas Imagine Raw
97                                                     DIPEx
98                         FARSITE v.4 Landscape File (.lcp)
99                                  NOAA Vertical Datum .GTX
100                        NADCON .los/.las Datum Grid Shift
101                                    NTv1 Datum Grid Shift
102                                    NTv2 Datum Grid Shift
103                                 CTable2 Datum Grid Shift
104                                                     ACE2
105                            Snow Data Assimilation System
106                                                KOLOR Raw
107                                           ROI_PAC raster
108                                                 R Raster
109                         Natural Resources Canada's Geoid
110                                Azavea Raster Grid format
111                                  Swedish Grid RIK (.rik)
112                       USGS Optional ASCII DEM (and CDED)
113                             GeoSoft Grid Exchange Format
114                  Northwood Numeric Grid Format .grd/.tab
115               Northwood Classified Grid Format .grc/.tab
116                            ARC Digitized Raster Graphics
117                      Standard Raster Product (ASRP/USRP)
118                                     Magellan topo (.blx)
119                                    PostGIS Raster driver
120                  SAGA GIS Binary Grid (.sdat, .sg-grd-z)
121                  IGN France height correction ASCII Grid
122                                        ASCII Gridded XYZ
123                               HF2/HFZ heightfield raster
124                                   OziExplorer Image File
125                           USGS LULC Composite Theme Grid
126                                 Arc/Info Export E00 GRID
127                                           ZMap Plus Grid
128                              NOAA NGS Geoid Height Grids
129                             IRIS data (.PPI, .CAPPi etc)
130                                      Racurs PHOTOMOD PRF
131                   DigitalGlobe Raster Data Access driver
132                              Earth Engine Data API Image
133          Airbus DS Intelligence Data As A Service driver
134                       Scaled Integer Gridded DEM .sigdem
135                                 IBM DB2 Spatial Database
136                                               GeoPackage
137                                           AutoCAD Driver
138                                   Planet Labs Scenes API
139                                              NextGIS Web
140                           Generic Binary (.hdr Labelled)
141                                       ENVI .hdr Labelled
142                                       ESRI .hdr Labelled
 [ reached 'max' / getOption("max.print") -- omitted 2 rows ]

[[1]]$python_utilities
      C:/PROGRA~1/GDAL/   
 [1,] "epsg_tr.py"        
 [2,] "esri2wkt.py"       
 [3,] "gcps2vec.py"       
 [4,] "gcps2wld.py"       
 [5,] "gdal_auth.py"      
 [6,] "gdal_calc.py"      
 [7,] "gdal_edit.py"      
 [8,] "gdal_fillnodata.py"
 [9,] "gdal_merge.py"     
[10,] "gdal_polygonize.py"
[11,] "gdal_proximity.py" 
[12,] "gdal_retile.py"    
[13,] "gdal_sieve.py"     
[14,] "gdal2tiles.py"     
[15,] "gdal2xyz.py"       
[16,] "gdalchksum.py"     
[17,] "gdalident.py"      
[18,] "gdalimport.py"     
[19,] "gdalmove.py"       
[20,] "mkgraticule.py"    
[21,] "pct2rgb.py"        
[22,] "rgb2pct.py"        

> getOption("gdalUtils_gdalPath")
[[1]]
[[1]]$path
[1] "C:/PROGRA~1/GDAL/"

[[1]]$version
version 
"3.0.0" 

[[1]]$date
        date 
"2019-05-05" 

[[1]]$drivers
                    format_code read write update virtualIO subdatasets
1                   BAG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
2                  FITS-raster- TRUE  TRUE   TRUE     FALSE       FALSE
3                   GMT-raster- TRUE  TRUE  FALSE     FALSE       FALSE
4                  HDF4-raster- TRUE FALSE  FALSE     FALSE        TRUE
5             HDF4Image-raster- TRUE  TRUE   TRUE     FALSE       FALSE
6                  HDF5-raster- TRUE FALSE  FALSE      TRUE        TRUE
7             HDF5Image-raster- TRUE FALSE  FALSE      TRUE       FALSE
8                   KEA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
9         netCDF-raster,vector- TRUE  TRUE   TRUE     FALSE        TRUE
10                  VRT-raster- TRUE  TRUE   TRUE      TRUE       FALSE
11              DERIVED-raster- TRUE FALSE  FALSE     FALSE       FALSE
12                GTiff-raster- TRUE  TRUE   TRUE      TRUE        TRUE
13                 NITF-raster- TRUE  TRUE   TRUE      TRUE        TRUE
14               RPFTOC-raster- TRUE FALSE  FALSE      TRUE        TRUE
15              ECRGTOC-raster- TRUE FALSE  FALSE      TRUE        TRUE
16                  HFA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
17             SAR_CEOS-raster- TRUE FALSE  FALSE      TRUE       FALSE
18                 CEOS-raster- TRUE FALSE  FALSE      TRUE       FALSE
19           JAXAPALSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
20                  GFF-raster- TRUE FALSE  FALSE      TRUE       FALSE
21                 ELAS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
22                  AIG-raster- TRUE FALSE  FALSE      TRUE       FALSE
23              AAIGrid-raster- TRUE  TRUE  FALSE      TRUE       FALSE
24       GRASSASCIIGrid-raster- TRUE FALSE  FALSE      TRUE       FALSE
25                 SDTS-raster- TRUE FALSE  FALSE      TRUE       FALSE
26                 DTED-raster- TRUE  TRUE  FALSE      TRUE       FALSE
27                  PNG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
28                 JPEG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
29                  MEM-raster- TRUE  TRUE   TRUE     FALSE       FALSE
30                 JDEM-raster- TRUE FALSE  FALSE      TRUE       FALSE
31                  GIF-raster- TRUE  TRUE  FALSE      TRUE       FALSE
32               BIGGIF-raster- TRUE FALSE  FALSE      TRUE       FALSE
33                 ESAT-raster- TRUE FALSE  FALSE      TRUE       FALSE
34                  BSB-raster- TRUE FALSE  FALSE      TRUE       FALSE
35                  XPM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
36                  BMP-raster- TRUE  TRUE   TRUE      TRUE       FALSE
37                DIMAP-raster- TRUE FALSE  FALSE      TRUE       FALSE
38               AirSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
39                  RS2-raster- TRUE FALSE  FALSE      TRUE        TRUE
40                 SAFE-raster- TRUE FALSE  FALSE      TRUE       FALSE
41        PCIDSK-raster,vector- TRUE  TRUE   TRUE      TRUE       FALSE
42             PCRaster-raster- TRUE  TRUE   TRUE     FALSE       FALSE
43                ILWIS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
44                  SGI-raster- TRUE  TRUE   TRUE      TRUE       FALSE
45              SRTMHGT-raster- TRUE  TRUE  FALSE      TRUE       FALSE
46             Leveller-raster- TRUE  TRUE   TRUE      TRUE       FALSE
47             Terragen-raster- TRUE  TRUE   TRUE      TRUE       FALSE
48                ISIS3-raster- TRUE  TRUE   TRUE      TRUE       FALSE
49                ISIS2-raster- TRUE  TRUE   TRUE      TRUE       FALSE
50                  PDS-raster- TRUE FALSE  FALSE      TRUE       FALSE
51          PDS4-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
52                VICAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
53                  TIL-raster- TRUE FALSE  FALSE      TRUE       FALSE
54                  ERS-raster- TRUE  TRUE   TRUE      TRUE       FALSE
55   JP2OpenJPEG-raster,vector- TRUE  TRUE  FALSE      TRUE       FALSE
56                  L1B-raster- TRUE FALSE  FALSE      TRUE        TRUE
57                  FIT-raster- TRUE  TRUE  FALSE      TRUE       FALSE
58                 GRIB-raster- TRUE  TRUE  FALSE      TRUE       FALSE
59                  RMF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
60                  WCS-raster- TRUE FALSE  FALSE      TRUE        TRUE
61                  WMS-raster- TRUE  TRUE  FALSE      TRUE        TRUE
62                 MSGN-raster- TRUE FALSE  FALSE      TRUE       FALSE
63                  RST-raster- TRUE  TRUE   TRUE      TRUE       FALSE
64                 INGR-raster- TRUE  TRUE   TRUE      TRUE       FALSE
65                 GSAG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
66                 GSBG-raster- TRUE  TRUE   TRUE      TRUE       FALSE
67                GS7BG-raster- TRUE  TRUE   TRUE      TRUE       FALSE
68                COSAR-raster- TRUE FALSE  FALSE      TRUE       FALSE
69                  TSX-raster- TRUE FALSE  FALSE      TRUE       FALSE
70                COASP-raster- TRUE FALSE  FALSE     FALSE       FALSE
71                    R-raster- TRUE  TRUE  FALSE      TRUE       FALSE
72                  MAP-raster- TRUE FALSE  FALSE      TRUE       FALSE
73      KMLSUPEROVERLAY-raster- TRUE  TRUE  FALSE      TRUE       FALSE
74           PDF-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
75           Rasterlite-raster- TRUE  TRUE  FALSE      TRUE        TRUE
76       MBTiles-raster,vector- TRUE  TRUE   TRUE      TRUE       FALSE
77             PLMOSAIC-raster- TRUE FALSE  FALSE     FALSE       FALSE
78                 CALS-raster- TRUE  TRUE  FALSE      TRUE       FALSE
79                 WMTS-raster- TRUE  TRUE  FALSE      TRUE       FALSE
80            SENTINEL2-raster- TRUE FALSE  FALSE      TRUE        TRUE
81                  MRF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
82                  PNM-raster- TRUE  TRUE   TRUE      TRUE       FALSE
83                 DOQ1-raster- TRUE FALSE  FALSE      TRUE       FALSE
84                 DOQ2-raster- TRUE FALSE  FALSE      TRUE       FALSE
85                 PAux-raster- TRUE  TRUE   TRUE      TRUE       FALSE
86                  MFF-raster- TRUE  TRUE   TRUE      TRUE       FALSE
87                 MFF2-raster- TRUE  TRUE   TRUE     FALSE       FALSE
88              FujiBAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
89                  GSC-raster- TRUE FALSE  FALSE      TRUE       FALSE
90                 FAST-raster- TRUE FALSE  FALSE      TRUE       FALSE
91                   BT-raster- TRUE  TRUE   TRUE      TRUE       FALSE
92                  LAN-raster- TRUE  TRUE   TRUE      TRUE       FALSE
93                  CPG-raster- TRUE FALSE  FALSE      TRUE       FALSE
94                  IDA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
95                  NDF-raster- TRUE FALSE  FALSE      TRUE       FALSE
96                  EIR-raster- TRUE FALSE  FALSE      TRUE       FALSE
97                DIPEx-raster- TRUE FALSE  FALSE      TRUE       FALSE
98                  LCP-raster- TRUE  TRUE  FALSE      TRUE       FALSE
99                  GTX-raster- TRUE  TRUE   TRUE      TRUE       FALSE
100              LOSLAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
101                NTv1-raster- TRUE FALSE  FALSE      TRUE       FALSE
102                NTv2-raster- TRUE  TRUE   TRUE      TRUE        TRUE
103             CTable2-raster- TRUE  TRUE   TRUE      TRUE       FALSE
104                ACE2-raster- TRUE FALSE  FALSE      TRUE       FALSE
105              SNODAS-raster- TRUE FALSE  FALSE      TRUE       FALSE
106                 KRO-raster- TRUE  TRUE   TRUE      TRUE       FALSE
107             ROI_PAC-raster- TRUE  TRUE   TRUE      TRUE       FALSE
108             RRASTER-raster- TRUE  TRUE   TRUE      TRUE       FALSE
109                 BYN-raster- TRUE  TRUE   TRUE      TRUE       FALSE
110                 ARG-raster- TRUE  TRUE  FALSE      TRUE       FALSE
111                 RIK-raster- TRUE FALSE  FALSE      TRUE       FALSE
112             USGSDEM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
113                 GXF-raster- TRUE FALSE  FALSE      TRUE       FALSE
114             NWT_GRD-raster- TRUE  TRUE   TRUE      TRUE       FALSE
115             NWT_GRC-raster- TRUE FALSE  FALSE      TRUE       FALSE
116                ADRG-raster- TRUE  TRUE   TRUE      TRUE        TRUE
117                 SRP-raster- TRUE FALSE  FALSE      TRUE        TRUE
118                 BLX-raster- TRUE  TRUE  FALSE      TRUE       FALSE
119       PostGISRaster-raster- TRUE  TRUE  FALSE     FALSE        TRUE
120                SAGA-raster- TRUE  TRUE   TRUE      TRUE       FALSE
121 IGNFHeightASCIIGrid-raster- TRUE FALSE  FALSE      TRUE       FALSE
122                 XYZ-raster- TRUE  TRUE  FALSE      TRUE       FALSE
123                 HF2-raster- TRUE  TRUE  FALSE      TRUE       FALSE
124                 OZI-raster- TRUE FALSE  FALSE      TRUE       FALSE
125                 CTG-raster- TRUE FALSE  FALSE      TRUE       FALSE
126             E00GRID-raster- TRUE FALSE  FALSE      TRUE       FALSE
127                ZMap-raster- TRUE  TRUE  FALSE      TRUE       FALSE
128            NGSGEOID-raster- TRUE FALSE  FALSE      TRUE       FALSE
129                IRIS-raster- TRUE FALSE  FALSE      TRUE       FALSE
130                 PRF-raster- TRUE FALSE  FALSE      TRUE       FALSE
131                 RDA-raster- TRUE FALSE  FALSE     FALSE       FALSE
132               EEDAI-raster- TRUE FALSE  FALSE     FALSE        TRUE
133                DAAS-raster- TRUE FALSE  FALSE     FALSE       FALSE
134              SIGDEM-raster- TRUE  TRUE  FALSE      TRUE       FALSE
135      DB2ODBC-raster,vector- TRUE  TRUE   TRUE     FALSE       FALSE
136         GPKG-raster,vector- TRUE  TRUE   TRUE      TRUE        TRUE
137          CAD-raster,vector- TRUE FALSE  FALSE      TRUE        TRUE
138     PLSCENES-raster,vector- TRUE FALSE  FALSE     FALSE       FALSE
139          NGW-raster,vector- TRUE  TRUE   TRUE     FALSE        TRUE
140              GenBin-raster- TRUE FALSE  FALSE      TRUE       FALSE
141                ENVI-raster- TRUE  TRUE   TRUE      TRUE       FALSE
142                EHdr-raster- TRUE  TRUE   TRUE      TRUE       FALSE
                                                 format_name
1                                 Bathymetry Attributed Grid
2                            Flexible Image Transport System
3                                     GMT NetCDF Grid Format
4                         Hierarchical Data Format Release 4
5                                               HDF4 Dataset
6                         Hierarchical Data Format Release 5
7                                               HDF5 Dataset
8                                    KEA Image Format (.kea)
9                                 Network Common Data Format
10                                            Virtual Raster
11                Derived datasets using VRT pixel functions
12                                                   GeoTIFF
13                      National Imagery Transmission Format
14                          Raster Product Format TOC format
15                                           ECRG TOC format
16                               Erdas Imagine Images (.img)
17                                            CEOS SAR Image
18                                                CEOS Image
19                JAXA PALSAR Product Reader (Level 1.1/1.5)
20  Ground-based SAR Applications Testbed File Format (.gff)
21                                                      ELAS
22                                      Arc/Info Binary Grid
23                                       Arc/Info ASCII Grid
24                                          GRASS ASCII Grid
25                                               SDTS Raster
26                                     DTED Elevation Raster
27                                 Portable Network Graphics
28                                                 JPEG JFIF
29                                          In Memory Raster
30                                       Japanese DEM (.mem)
31                        Graphics Interchange Format (.gif)
32                        Graphics Interchange Format (.gif)
33                                      Envisat Image Format
34                               Maptech BSB Nautical Charts
35                                         X11 PixMap Format
36                      MS Windows Device Independent Bitmap
37                                                SPOT DIMAP
38                                 AirSAR Polarimetric Image
39                                    RadarSat 2 XML Product
40                               Sentinel-1 SAR SAFE Product
41                                      PCIDSK Database File
42                                      PCRaster Raster File
43                                          ILWIS Raster Map
44                                 SGI Image File Format 1.0
45                                       SRTMHGT File Format
46                                      Leveller heightfield
47                                      Terragen heightfield
48                   USGS Astrogeology ISIS cube (Version 3)
49                   USGS Astrogeology ISIS cube (Version 2)
50                                NASA Planetary Data System
51                              NASA Planetary Data System 4
52                                           MIPL VICAR file
53                                           EarthWatch .TIL
54                                    ERMapper .ers Labelled
55                JPEG-2000 driver based on OpenJPEG library
56                      NOAA Polar Orbiter Level 1b Data Set
57                                                 FIT Image
58                              GRIdded Binary (.grb, .grb2)
59                                      Raster Matrix Format
60                                  OGC Web Coverage Service
61                                       OGC Web Map Service
62                            EUMETSAT Archive native (.nat)
63                                         Idrisi Raster A.1
64                                         Intergraph Raster
65                         Golden Software ASCII Grid (.grd)
66                        Golden Software Binary Grid (.grd)
67                      Golden Software 7 Binary Grid (.grd)
68                COSAR Annotated Binary Matrix (TerraSAR-X)
69                                        TerraSAR-X Product
70                           DRDC COASP SAR Processor Raster
71                                       R Object Data Store
72                                          OziExplorer .MAP
73                                         Kml Super Overlay
74                                            Geospatial PDF
75                                                Rasterlite
76                                                   MBTiles
77                                   Planet Labs Mosaics API
78                                             CALS (Type 1)
79                                  OGC Web Map Tile Service
80                                                Sentinel 2
81                                        Meta Raster Format
82                           Portable Pixmap Format (netpbm)
83                                      USGS DOQ (Old Style)
84                                      USGS DOQ (New Style)
85                                         PCI .aux Labelled
86                                         Vexcel MFF Raster
87                                  Vexcel MFF2 (HKV) Raster
88                                    Fuji BAS Scanner Image
89                                               GSC Geogrid
90                                         EOSAT FAST Format
91                       VTP .bt (Binary Terrain) 1.3 Format
92                                           Erdas .LAN/.GIS
93                                           Convair PolGASP
94                                   Image Data and Analysis
95                                         NLAPS Data Format
96                                         Erdas Imagine Raw
97                                                     DIPEx
98                         FARSITE v.4 Landscape File (.lcp)
99                                  NOAA Vertical Datum .GTX
100                        NADCON .los/.las Datum Grid Shift
101                                    NTv1 Datum Grid Shift
102                                    NTv2 Datum Grid Shift
103                                 CTable2 Datum Grid Shift
104                                                     ACE2
105                            Snow Data Assimilation System
106                                                KOLOR Raw
107                                           ROI_PAC raster
108                                                 R Raster
109                         Natural Resources Canada's Geoid
110                                Azavea Raster Grid format
111                                  Swedish Grid RIK (.rik)
112                       USGS Optional ASCII DEM (and CDED)
113                             GeoSoft Grid Exchange Format
114                  Northwood Numeric Grid Format .grd/.tab
115               Northwood Classified Grid Format .grc/.tab
116                            ARC Digitized Raster Graphics
117                      Standard Raster Product (ASRP/USRP)
118                                     Magellan topo (.blx)
119                                    PostGIS Raster driver
120                  SAGA GIS Binary Grid (.sdat, .sg-grd-z)
121                  IGN France height correction ASCII Grid
122                                        ASCII Gridded XYZ
123                               HF2/HFZ heightfield raster
124                                   OziExplorer Image File
125                           USGS LULC Composite Theme Grid
126                                 Arc/Info Export E00 GRID
127                                           ZMap Plus Grid
128                              NOAA NGS Geoid Height Grids
129                             IRIS data (.PPI, .CAPPi etc)
130                                      Racurs PHOTOMOD PRF
131                   DigitalGlobe Raster Data Access driver
132                              Earth Engine Data API Image
133          Airbus DS Intelligence Data As A Service driver
134                       Scaled Integer Gridded DEM .sigdem
135                                 IBM DB2 Spatial Database
136                                               GeoPackage
137                                           AutoCAD Driver
138                                   Planet Labs Scenes API
139                                              NextGIS Web
140                           Generic Binary (.hdr Labelled)
141                                       ENVI .hdr Labelled
142                                       ESRI .hdr Labelled
 [ reached 'max' / getOption("max.print") -- omitted 2 rows ]

[[1]]$python_utilities
      C:/PROGRA~1/GDAL/   
 [1,] "epsg_tr.py"        
 [2,] "esri2wkt.py"       
 [3,] "gcps2vec.py"       
 [4,] "gcps2wld.py"       
 [5,] "gdal_auth.py"      
 [6,] "gdal_calc.py"      
 [7,] "gdal_edit.py"      
 [8,] "gdal_fillnodata.py"
 [9,] "gdal_merge.py"     
[10,] "gdal_polygonize.py"
[11,] "gdal_proximity.py" 
[12,] "gdal_retile.py"    
[13,] "gdal_sieve.py"     
[14,] "gdal2tiles.py"     
[15,] "gdal2xyz.py"       
[16,] "gdalchksum.py"     
[17,] "gdalident.py"      
[18,] "gdalimport.py"     
[19,] "gdalmove.py"       
[20,] "mkgraticule.py"    
[21,] "pct2rgb.py"        
[22,] "rgb2pct.py"        
chrisvwn commented 4 years ago

@calvinke were you able to use gdal after running gdal_setInstallation()? That should actually have fixed the issue of not finding the gdal installation. The output you posted above looks good now.

calvinke commented 4 years ago

This is what I get:

> library(Rnightlights)
> library(lubridate)

Attaching package: ‘lubridate’

The following object is masked from ‘package:base’:

    date

> library(reshape2)
> library(curl)
> library(gdalUtils)
> gdal_setInstallation()
> pkgOptions(downloadMethod="auto", cropMaskMethod="gdal", extractMethod="gdal", deleteTiles=TRUE)
> ctry <- "IND"
> getnldata_VIIRS<-getCtryNlData(ctryCode="IND", admLevel="adm0", custPolyPath="C://Users/Documents/Data/alan/India.zip", nlType="VIIRS.Y", nlPeriods="2015", nlStats=c("sum","mean"), ignoreMissing=FALSE)
Processing missing data: IND:VIIRS.Y:VCM-ORM-NTL:2015:mean. This may take a while. 
Note: Set 'ignoreMissing=TRUE' to return only data found or 
'ignoreMissing=NULL' to return NULL if not all the data is found
2019-12-18 17:39:06: **** START PROCESSING: ctryCodes=IND, admLevels=list(India.zip = "0_IAGE71FL_Buffer"), nlTypes=VIIRS.Y, configNames=VCM-ORM-NTL, multiTileStrategy=all, multiTileMergeFun=mean, removeGasFlares=TRUE, nlPeriods=2015, nlStats=c("sum", "mean"), custPolyPath=C://Users/Documents/Data/alan/India.zip, gadmVersion=3.6, gadmPolyType=shpZip, downloadMethod=auto, cropMaskMethod=gdal, extractMethod=gdal****
2019-12-18 17:39:06: Downloading country polygons ...
  |                                                                                                            |   0%2019-12-18 17:39:06: Downloading polygon: IND
2019-12-18 17:39:06: Downloading ctry poly: IND
2019-12-18 17:39:06: Downloading ctry shpZip: IND
2019-12-18 17:39:06: Polygon dir for IND:India.zip already exists
  |============================================================================================================| 100%
2019-12-18 17:39:06: Downloading country polygons ... DONE
2019-12-18 17:39:06: **** PROCESSING nlType:VIIRS.Y | configName: VCM-ORM-NTL | nlPeriod:2015****
2019-12-18 17:39:06: Checking tiles required for VIIRS.Y 2015
2019-12-18 17:39:06: IND: cropped raster exists. Tile not required
2019-12-18 17:39:06: numTiles: 0, Required tiles: 
2019-12-18 17:39:06: No tiles needed for 2015. Processing countries with missing stats and existing cropped rasters
2019-12-18 17:39:06: Processing ctryCode: IND
2019-12-18 17:39:06: Processing ctryCode: IND AdmLevel: 0_IAGE71FL_Buffer
2019-12-18 17:39:06: ProcessNlCountry: ctryCode=IND, admLevel=0_IAGE71FL_Buffer, nlType=VIIRS.Y, configName=VCM-ORM-NTL, multiTileStrategy=all, multiTileMergeFun=mean, removeGasFlares=TRUE, nlPeriod=2015, nlStats=c("sum", "mean"), downloadMethod=auto, cropMaskMethod=gdal, extractMethod=gdal, gadmVersion=3.6, gadmPolyType=shpZip, custPolyPath=C://Users/Documents/Data/alan/India.zip****
2019-12-18 17:39:06: Check for existing data file
2019-12-18 17:39:06: Data file found: C:/Users/Documents/.Rnightlights/data/NL_DATA_IND_IND_0_IAGE71FL_BUFFER_CUST-India.zip.csv
2019-12-18 17:39:06: Processing stats: mean()
2019-12-18 17:39:06: Load country data file
2019-12-18 17:39:07: Load country polygon admin level
2019-12-18 17:39:07: Begin processing 2015
2019-12-18 17:39:07: C:/Users/Documents/.Rnightlights/outputrasters/NL_IND_VIIRS.Y_2015_VCM-ORM-NTL-MTSALL-MEAN-RGFT_CUST-India.zip-SHPZIP.tif already exists
2019-12-18 17:39:07: Begin extracting data from the raster 
2019-12-18 17:39:12: Zonal file C:/Users/Documents/.Rnightlights/zonals/NL_ZONAL_IND_ADM0_VIIRS.Y_GFT_India.zip-SHPZIP.tif doesn't exist. Creating ... 
2019-12-18 17:39:12: Creating zonal raster
ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_identify: Cannot find proj.db
ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
0ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db
...10...20...30...40...50...60...70...80...90...100 - done.
2019-12-18 17:39:27: Compressing zonal raster
Error in gdal_chooseInstallation(hasDrivers = of) : 
  No installations match.
chrisvwn commented 4 years ago

Hmm. This error is new and I am wondering if it is related to the problem finding the gdal installation:

ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_identify: Cannot find proj.db
ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
0ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_create_from_wkt: Cannot find proj.db
ERROR 1: PROJ: proj_as_wkt: Cannot find proj.db

Could you try running gdal_setInstallation(verbose=TRUE) again and then re-run the function? Please post the output if it does not work.

calvinke commented 4 years ago

I tried to re-run the function, but as I previously ran this successfully without gdal, I get the messages "All stats exist" and "Retrieving requested data". I tried to click clear all objects from the workspace but it doesn't change anything. How do I reset the function?

chrisvwn commented 4 years ago

Hey @calvinke Apologies I hadn't seen your reply. To clear stats you can delete the country file in the data directory under the .Rnightlights directory. You can get the data directory by running Rnightlights::getNlDir("dirNlData").

chrisvwn commented 4 years ago

Closing this issue for now. If you would like to pursue this further please reopen.