domainaware / parsedmarc

A Python package and CLI for parsing aggregate and forensic DMARC reports
https://domainaware.github.io/parsedmarc/
Apache License 2.0
981 stars 212 forks source link

IMAP too many open files #357

Open rainer-tammer opened 1 year ago

rainer-tammer commented 1 year ago

Hello, after less a day I get the following error:

parsedmarc 8.3.1 python 3.9.13

Sep 29 08:19:23 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:28 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:33 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:38 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:43 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:48 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:53 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:19:58 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:20:03 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting... Sep 29 08:20:08 dmarc01 parsedmarc[388]: WARNING:imap.py:74:IMAP connection error. [Errno 24] Too many open files. Reconnecting...

Any ideas?

Bye Rainer

AnaelMobilia commented 1 year ago

Hello,

The "[Errno 24] Too many open files" really look like a linux OS issue with adjustment to be made on the OS level. See for example this link (to be adapted on your OS, see OS documentation on this point).

Bests regards, Anael

rainer-tammer commented 1 year ago

Hello, I do not think that this is the problem. The process did run for some time and then it failed. I have currently ~ 2000 descriptors in use and the configured limit is 32768.

Bye Rainer Tammer

rainer-tammer commented 1 year ago

Hello, Any news?

Bye Rainer