search

systemapic / pile

PostGIS tile server
0 stars 2 forks source link

Running out of memory rendering tiles from PostGIS raster #26

Closed knutole closed 8 years ago

knutole commented 8 years ago

Rendering tiles from PostGIS raster ends up with using all available RAM - and never releasing it.

Steps to reproduce:

  1. Import a raster
  2. Zoom in a bit, say to level 10 or 11. (Basically, request a lot of tiles.)
  3. Watch RAM being eaten up:

screen shot 2016-02-26 at 10 31 15 am

Sending SIGINT to the node instance running pile flushes all memory.

strk commented 8 years ago

Please file a separate ticket for Invalid height for image dimensions requested, let's keep this one for the out-of-memory issue.

Which docker gets the out-of-memory condition ?

I believe https://github.com/systemapic/wu/issues/479 would help, for high zoom levels, will deal with it after trying to reproduce.

knutole commented 8 years ago

Invalid height issue: https://github.com/systemapic/pile/issues/27

strk commented 8 years ago

I could reproduce the RAM issue locally. I had ~6 pile processes each taking > 15% of RAM. The system filled up all SWAP space too and it was a huge pain to kill those node processes.

One curious thing I noticed is that running "top" from the host showed more "pile" processes than running "top" from the "pile" docker. Any idea about why would that be possible ?

strk commented 8 years ago

I believe we did solve this with acc4e20ae5566b7de28720741a9e9ad33f43884d, feel free to reopen if this is not the case.