dshean / demcoreg

Utilities for DEM and point cloud co-registration
MIT License
110 stars 42 forks source link

Programme being killed after 1 interaction #50

Closed mikeyJ-1999 closed 1 year ago

mikeyJ-1999 commented 2 years ago

Hi, I keep getting this issue after 1 Interaction:

~/src/demcoreg/demcoreg/dem_align.py -max_offset 250 28-06-2012_E_BI.tif 22-04-2016_E_BI.tif

Reference: 28-06-2012_E_BI.tif Source: 22-04-2016_E_BI.tif Mode: nuth Output: 22-04-2016_E_BI_dem_align/22-04-2016_E_BI_28-06-2012_E_BI

Warping all inputs to the following: Resolution: 2.0 Extent: [-1970264.0, -517090.0, -1899022.0, -482764.0] Projection: '+proj=stere +lat_0=90 +lat_ts=70 +lon_0=-45 +x_0=0 +y_0=0 +datum=WGS84 +units=m +no_defs' Resampling alg: cubic

1 of 2: 28-06-2012_E_BI.tif nl: 17163 ns: 35621 res: 2.000 0...10...20...30...40...50...60...70...80...90...100 - done. 2 of 2: [memory]

Reference DEM res: 2.00 Source DEM res: 2.00 Resolution for coreg: mean (2.00 m)

Iteration 1

Warping all inputs to the following: Resolution: 2.0 Extent: [-1970264.0, -517090.0, -1899022.0, -482764.0] Projection: '+proj=stere +lat_0=90 +lat_ts=70 +lon_0=-45 +x_0=0 +y_0=0 +datum=WGS84 +units=m +no_defs' Resampling alg: cubic

1 of 2: 28-06-2012_E_BI.tif 2 of 2: [memory] Killed

I'm using a Ubuntu Virtual Machine with minicoda 3

dshean commented 2 years ago

Hi @mikeyJ-1999. Thanks for filing an issue. This looks like a memory issue. How much memory do you have available on your VM?
Your inputs are relatively large, and assuming float32 or float64, will require a lot of RAM for in-memory warping. Depending on VM OS config, there may also be some monitoring that kills processes occupying lots of RAM.

mikeyJ-1999 commented 1 year ago

Hi

Thank you for the reply

I'm current allocating 10gb of ram to the virtual machine and allocated 250gb of storage. When I try to run the terminal now it closes without giving any errors

dshean commented 1 year ago

OK. 10 GB is not much for uncompressed in-memory storage of your large rasters, but maybe OK swapping to disk.

Just to confirm "closes without giving any errors" means that the script successfully ran to completion, or that it prematurely exits without throwing an error?

mikeyJ-1999 commented 1 year ago

Sorry for the cofusion. It closes without giving any errors.