aksnzhy / xlearn

High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.
https://xlearn-doc.readthedocs.io/en/latest/index.html
Apache License 2.0
3.09k stars 519 forks source link

do you have still memory leak described in RecoTour? #328

Open Sandy4321 opened 4 years ago

Sandy4321 commented 4 years ago

do you have still memory leak described in RecoTour? https://github.com/jrzaurin/RecoTour/blob/master/Ponpare/Chapter12_FMs_Recommendations.ipynb

I run this on a c5n.4xlarge instance with 40GB of memory and by the time it finished it had almost consumed it all. Previously, when using a c5.4xlarge (30GB) I got the always nice Memory error message "Killed" in the terminal

I am not sure whether there is a memory leak in the package or some other memory related issue because every iteration accumulates a lot of memory (around 3GB)