search

ssec / sift

A visualization application for satellite imagery
http://sift.ssec.wisc.edu/
GNU General Public License v3.0
49 stars 14 forks source link

RAM usage with MTG LI data #429

Open g8sqh opened 2 months ago

g8sqh commented 2 months ago

I'm using SIFT_2.0.0b1 to view MTG LI data (via my EUMETCAST system)

ON a Linux system with 64G of RAM, I can only load around 30 timesteps of LI L2 netCDF data before SIFT crashes 'bus error' - as its RAM usage (RES in top) exceed 32G.

Upto the crash the data is rendering and animating fine - but this only allowed a few minutes to be loaded at once.

Have I done something stupid (I'm new to SIFT)? Since I only want a small area of the globe - should I have filtered the files I loaded to only include my area?

Many thanks

ameraner commented 1 month ago

Hi @g8sqh , thank you for reporting this. I don't think you're doing anything wrong here, also filtering the files beforehand for regions is not really possible unfortunately. Which specific product are you loading, point or accumulated? This might be realted to e.g. https://github.com/pytroll/satpy/issues/2854 or similar issues - the LI reader is still at an early (load) testing stage.