Closed cwehmeyer closed 6 years ago
I assume that you have already restarted the OS and have re-run this particular script? Otherwise we do not have any clue if this is really caused by running multiple jobs or not. There are only two obvious new file descriptors in this place of code, so it should not be too much IMHO.
Or before rebooting, check how many descriptors are already open before and after starting multiple processes.
https://stackoverflow.com/questions/20974438/get-list-of-open-files-descriptors-in-os-x
Maybe this is helpful as well (increases max fd): https://superuser.com/questions/302754/increase-the-maximum-number-of-open-file-descriptors-in-snow-leopard
Looks like I used too many resources on my machine. Now it works, thanks!
Thanks for the feedback!
I'm using
pyemma-2.5.2
on macOS HighSierra (10.13.4) and tried to run acktest()
for a bayesian HMM. With the default parametern_jobs=1
, everything works fine. But withn_jobs=2
, anOSError: [Errno 24] Too many open files
is thrown (see Traceback for details).Traceback
```Python traceback --------------------------------------------------------------------------- OSError Traceback (most recent call last)My conda environment
``` # Name Version Build Channel absl-py 0.1.10 py_0 conda-forge appnope 0.1.0 py36_0 conda-forge asn1crypto 0.24.0 py36_0 astor 0.6.2 py_0 conda-forge backcall 0.1.0 py_0 conda-forge bhmm 0.6.2 py36_1 conda-forge bleach 2.1.3 py_0 conda-forge blosc 1.14.0 1 conda-forge bzip2 1.0.6 1 conda-forge ca-certificates 2018.4.16 0 conda-forge certifi 2018.4.16 py36_0 conda-forge cffi 1.11.5 py36h342bebf_0 chardet 3.0.4 py36h96c241c_1 conda 4.5.4 py36_0 conda-forge conda-env 2.6.0 h36134e3_0 cryptography 2.2.2 py36h1de35cc_0 cycler 0.10.0 py36_0 conda-forge cython 0.28.2 py36_0 conda-forge decorator 4.3.0 py_0 conda-forge deeptime 0.1.4.dev15+g1b260f1