search

ucd-cws / ca-naip

Indexes and Additional Information for California's National Agriculture Imagery Program (NAIP)
0 stars 0 forks source link

Time a complete cell #15

Open qjhart opened 9 years ago

qjhart commented 9 years ago

Let's run gdal bbuildvrt, retile on a complete (256) cell, and get some time estimates. Let's go up to level 7 for that. WE've decided on the Lake Tahoe cell.

ghost commented 9 years ago

i ran 'time gdal_retile.py -r cubic -levels 7 -ps 2048 2048 -co "QUALITY=50" -of WEBP -targetDir foo_39120 naip_39120_ca_albers.vrt' and got real 55m12.489s, user 51m11.061s, sys 2m1.324s. However, this is not using SLURM nor using the optimization with gdal. The GDAL_CACHEMAX may be set as an environmental variable (export GDAL_CACHEMAX=500) or with an individual command with the --config option, i.e. --config GDAL_CACHEMAX 500, https://trac.osgeo.org/gdal/wiki/UserDocs/GdalWarp so we might try optimization. While the -wm flag is for gdalwarp, the GDAL_CACHEMAX should affect many of the gdal commands.