Closed nkruskamp closed 3 years ago
This also occurs with .tif files. I am still unable to identify why it is happening.
Submitted an issue w/ terra
rspatial/terra#237
I am assuming that this happens if just opening the file and classifying NA's to 0s?
Yes exactly. The sample code I shared in the terra issue creates a random noise raster and then tries to reclassify. Did we add reclassify in rpops recently? I assumed it is a terra update that has caused this.
we moved from raster::reclassify to terra::classify which hasn't caused issues until now. Orginally I was checking for NA values in cells then setting those to 0 but that was about 2x longer than reclassify was that might be an option but is significantly slower.
This was an issue with using the TILED creation option with very large tif files.
I'm going to open this ticket to track it for others if they have a similar issue, although I think this may be an issue with terra. When dealing with a really large weather coefficient .vrt file [2100 x 4650 pixels, 520 layers], I get the following error. I've encountered this on a Linux cluster and a Windows workstation when running
pops_validate.
Here's a traceback:This appears to happen when terra tried to reclass NA pixels to 0. I am looking at if this impacts other raster file types such as GTiff.
There is a core dump file generated from the cluster, but I don't know how to examine it to understand the problem better.