OSError: [Errno 24] Too many open files

flennerhag / mlens

ML-Ensemble – high performance ensemble learning

http://ml-ensemble.com

MIT License

843 stars 108 forks source link

OSError: [Errno 24] Too many open files #132

Closed joeybaba closed 4 years ago

joeybaba commented 4 years ago

macbook， when i fit the data, error happen.

error still persist, after i set 'ulimit -n 4096'

flennerhag commented 4 years ago

Hi,

It's hard to tell with such a generic description, but presumably, this happens because you're using memory mapping with too many cross-validation folds. You can try running with backend='threading' (this is the default) or try reducing the number of CV folds. In particular, you can run into this issue if you're using the subsemble method. An alternative is to set ulimit -n 30000 or something such.