elastic / eland

Python Client and Toolkit for DataFrames, Big Data, Machine Learning and ETL in Elasticsearch
https://eland.readthedocs.io
Apache License 2.0
628 stars 98 forks source link

Investigate model test failures in CI #633

Open davidkyle opened 8 months ago

davidkyle commented 8 months ago

The tests added in #623 can cause occasional build failures. Sometimes the console log just ends without any errors and sometimes there is a message along the lines of pytest failed with exit code -9.

The problem appears to be due to memory consumption as the tests pass when building on a larger machine. For example the tests passed when 52GB machine was used in https://github.com/elastic/eland/pull/625/commits/a98887714da98aa390cc3998e3d097653b76ea27

That change was not merged as build should not require so much memory.