flashmob
commented
5 years ago What is the output of
sudo lsof | wc -l
probably there is a a tutorial for more lsof command options that will let you drill down to see who
Also, decrease your save_workers_size workers to about 2 or 4.
On Tue., 3 Sep. 2019, 16:25 Lord Alfred, notifications@github.com wrote:
Tonight I got a lot of errors in log when almost 30 thousand letters arrived in a short time:
time="2019-09-03T08:00:06+03:00" level=error msg="doQuery error" error="dial tcp 127.0.0.1:3306: socket: too many open files" time="2019-09-03T08:00:06+03:00" level=error msg="doQuery error" error="dial tcp 127.0.0.1:3306: socket: too many open files" time="2019-09-03T08:00:06+03:00" level=error msg="doQuery error" error="dial tcp 127.0.0.1:3306: socket: too many open files" time="2019-09-03T08:00:06+03:00" level=error msg="There was a problem the insert" error="dial tcp 127.0.0.1:3306: socket: too many open files" time="2019-09-03T08:00:06+03:00" level=error msg="There was a problem the insert" error="dial tcp 127.0.0.1:3306: socket: too many open files" time="2019-09-03T08:00:06+03:00" level=error msg="storage error" time="2019-09-03T08:00:06+03:00" level=error msg="storage error" time="2019-09-03T08:00:06+03:00" level=error msg="storage error"
But my limits is:
$ ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 31784 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 65535 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 65535 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited
And when I installed I did the following:
limitations: https://medium.com/@muhammadtriwibowo/set-permanently-ulimit-n-open-files-in-ubuntu-4d61064429a
ulimit -n 65535 /bin/su -c "echo 'fs.file-max = 65535' >> /etc/sysctl.conf" sysctl -p
/bin/su -c "echo ' soft nproc 65535' >> /etc/security/limits.conf" /bin/su -c "echo ' hard nproc 65535' >> /etc/security/limits.conf" /bin/su -c "echo ' soft nofile 65535' >> /etc/security/limits.conf" /bin/su -c "echo ' hard nofile 65535' >> /etc/security/limits.conf" /bin/su -c "echo 'root soft nproc 65535' >> /etc/security/limits.conf" /bin/su -c "echo 'root hard nproc 65535' >> /etc/security/limits.conf" /bin/su -c "echo 'root soft nofile 65535' >> /etc/security/limits.conf" /bin/su -c "echo 'root hard nofile 65535' >> /etc/security/limits.conf"
/bin/su -c "echo 'session required pam_limits.so' >> /etc/pam.d/common-session"
My config is:
{... "backend_config": {... "save_workers_size": 250, "save_process": "HeadersParser|Hasher|Header|BenderSql",... "gw_save_timeout": "30s", "gw_val_rcpt_timeout": "3s", "sql_driver": "mysql", "sql_dsn": "BM_DB_USERNAME:BM_DB_PASSWORD@tcp(BM_DB_HOST:BM_DB_PORT)/BM_DB_DATABASE?readTimeout=10s&writeTimeout=10s&charset=utf8mb4&collation=utf8mb4_unicode_ci", "mail_table": "messages", "sql_max_open_conns": 250, "sql_max_idle_conns": 150, "sql_max_conn_lifetime": "200s" }, "servers": [ {... "max_size": 3145728, "timeout":180, "listen_interface":"0.0.0.0:25", "max_clients": 1000,... }, {... "timeout":15, "listen_interface":"127.0.0.1:2525", "max_clients": 10,... } ] }
Need a larger limit, or somewhere there may be a mistake?
PS: Ubuntu 16.04 x64, 8CPU cores / 8GB RAM
— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/flashmob/go-guerrilla/issues/186?email_source=notifications&email_token=AAE6MP3N5P5AO42HTWR23OLQHYGPZA5CNFSM4ITC35U2YY3PNVWWK3TUL52HS4DFUVEXG43VMWVGG33NNVSW45C7NFSM4HI46NBA, or mute the thread https://github.com/notifications/unsubscribe-auth/AAE6MP7ATVZP2SOGKVKWP4LQHYGPZANCNFSM4ITC35UQ .
lord-alfred
Tonight I got a lot of errors in log when almost 30 thousand letters arrived in a short time:
But my limits is:
And when I installed I did the following:
My config is:
(second server need for monit task)
Need a larger limit, or somewhere there may be a mistake?
PS: Ubuntu 16.04 x64, 8CPU cores / 8GB RAM