search

h2oai / h2o-tutorials

Tutorials and training material for the H2O Machine Learning Platform
http://h2o.ai
1.48k stars 1.01k forks source link

memory leaks - is this JVM or H2O issue? #166

Open algomaschine opened 1 year ago

algomaschine commented 1 year ago

Gents, I'm running the following code to train models from many data files in the directory. It's running for 5 min per model and like this for about 48h now. Now I notice the memory leaks are starting to appear, most of the RAM is already utilized. Seems like a garbage collector on the end of every model training is not doing its job well (because I close the h2o instance server and reinitialize it for every new model). Can you please advise what can I write in code (calling H2O methods) to perform an explicit memory cleanout after a model is saved? Thanks!

image

image

algomaschine commented 1 year ago

Windows Server 2016, 64bit Python 3.7.9