JaroCamphuijsen / TCM

Different aspects of tropical cyclones modelling
0 stars 0 forks source link

Import ERA5 data without OMUSE #6

Open Ireneben73 opened 11 months ago

Ireneben73 commented 11 months ago

ERA5 data import from the external forcings file currently fails due to memory issues.

JaroCamphuijsen commented 10 months ago

This is in fact, the expected behavior of running model instances in parallel. If they all load an external forcing dataset in memory, this will result in memory error. The real underlying required feature request is to be able to have external forcing other than ERA5 data (using the omuse ERA5 interface), as a model input. This is related to issues https://github.com/omuse-geoscience/omuse/issues/79 and https://github.com/omuse-geoscience/omuse/issues/82. The problem will be solved by PR https://github.com/omuse-geoscience/omuse/pull/87. Although that will not enable the data import through the external forcing file of the model instance, this is considered inefficient use of AMUSE anyway. A better way to do this is allowing any netcdf file as external forcing in OMUSE. For that we are implementing a "data interface" to OMUSE in https://github.com/omuse-geoscience/omuse/pull/87.