Trusted-AI / AIF360

A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
https://aif360.res.ibm.com/
Apache License 2.0
2.46k stars 840 forks source link

Memory leaks from splitting the standarddataset in evolutionary algorithm #272

Open leothyssen opened 3 years ago

leothyssen commented 3 years ago

Line 114 of the attached .py file leads to a memory leak and crash after several thousands of iterations 133501333-f45a4790-29c9-45cc-a53d-b08804b5d855 when called from the attached notebook. The error is resolved when setting moving it out of the looped eval method.

This problem persists when calling

del dataset_orig_train del dataset_orig_test gc.collect() The attached files can be found here