search

equinor / ert

ERT - Ensemble based Reservoir Tool - is designed for running ensembles of dynamical models such as reservoir models, in order to do sensitivity analysis and data assimilation. ERT supports data assimilation using the Ensemble Smoother (ES), Ensemble Smoother with Multiple Data Assimilation (ES-MDA) and Iterative Ensemble Smoother (IES).
https://ert.readthedocs.io/en/latest/
GNU General Public License v3.0
104 stars 107 forks source link

Excessive memory usage when opening plotter with large storage #9289

Open eivindjahren opened 1 week ago

eivindjahren commented 1 week ago

In an model seen in real use, storage had two ensembles, each 20gb, 200 realizations and 100mb of summary.parquet. The summary had 60,000 columns. This caused opening the plotter to run out of memory on beefy tgx nodes.

oyvindeide commented 4 days ago

This does not seem to be a new issue?

eivindjahren commented 3 days ago

@oyvindeide The old issue was about a timeout while this is excessive memory usage.