search

NCAR / VAPOR

VAPOR is the Visualization and Analysis Platform for Ocean, Atmosphere, and Solar Researchers
https://www.vapor.ucar.edu/
BSD 3-Clause "New" or "Revised" License
179 stars 49 forks source link

Volume Renderer taking >32GB memory on a 0.4GB data file #3618

Closed shaomeng closed 1 month ago

shaomeng commented 5 months ago

WRF file /glade/campaign/collections/rda/data/ds559.0/wy2022/202110/wrf2d_d01_2021-10-01_00:00:00.nc is ~0.4GB on disk. Its 3D variables are at a resolution of 1367x1015x4. After importing it to VAPOR and enabling a volume renderer, CISL-VAPOR (Ubuntu 22.04, 32GB memory) hangs because of VAPOR consuming all the memory.

There seems to be serious memory issues in VAPOR. Even if a machine equipped with more memory is able to successfully render this data set, the ratio between data/memory size prohibits volume rendering a moderately big file.

NihanthCW commented 5 months ago

Question: Is Ospray enabled?

shaomeng commented 4 months ago

Question: Is Ospray enabled?

This behavior was observed using the "Curvilinear" renderer, not the Ospray renderer.

StasJ commented 4 months ago

I tested this on my mac and vapor used about 1.3GB of RAM to volume render this file. It was running very slow, however, and this is due to the shape of the cells. Here is a part of a single row of cells: s

StasJ commented 4 months ago

This dataset also appears to be incorrectly marked as curvilinear and can be rendered in real-time using the Regular volume rendering algorithm.

NihanthCW commented 3 months ago

@StasJ @shaomeng If this is resolved/ is an issue with the specific use case, we can close this issue.

shaomeng commented 3 months ago

@StasJ @shaomeng If this is resolved/ is an issue with the specific use case, we can close this issue.

You know what, VAPOR (3.9.2 installer) doesn't show any 3D variables on Casper and MacOS, so I cannot verify the reported issue on these 2 platforms. Seems weird to me and seems there's something else going on in VAPOR, but this particular issue is at a "not verifiable" state for me.

@StasJ , you seem to be able to create a volume renderer based on this file on MacOS. Did you use the 3.9.2 installer, or a custom build?

StasJ commented 3 months ago

It works when building from source.