search

nansencenter / nansat

Scientist friendly Python toolbox for processing 2D satellite Earth observation data.
http://nansat.readthedocs.io
GNU General Public License v3.0
181 stars 66 forks source link

Domain.get_geolocation_grids has an memory issue #154

Open aleksandervines opened 8 years ago

aleksandervines commented 8 years ago

On one RS2 file it kills the entire python process, on another it produces a memory error

When running the function, all memory is eaten up. Must troubleshoot more to see if it's only with my local installation or a general problem.

This is with 4GB memory on the VM.

RS2_OK57403_PK539140_DK477416_SCWA_20141022_152035_HH_SGF.ZIP is killing RS2_OK29747_PK294181_DK265214_FQ23_20100508_120125_HH_VV_HV_VH_SLC.zip is causing MemoryError

aleksandervines commented 8 years ago

With 10 GB memory, it seems the second file processed properly. The first still caused the death of the python process, even though it did not use up all memory.

aleksandervines commented 8 years ago

The error seems to be a segmentation fault somewhere in the gdal c library when processing

/home/vagrant/miniconda/lib/python2.7/site-packages/osgeo/gdal.py(1680)TransformPoints() -> return _gdal.Transformer_TransformPoints(self, *args) (Pdb) Segmentation fault (core dumped)

The call works if calling with stepSize=100, as the RS2 mapper is using.

akorosov commented 8 years ago

More tests are needed