search

mailcow / mailcow-dockerized

mailcow: dockerized - 🐮 + 🐋 = 💕
https://mailcow.email
GNU General Public License v3.0
8.97k stars 1.18k forks source link

Watchdog: php-fpm-mailcow service hit the error rate limit - every ~15 minutes #1141

Closed ghost closed 6 years ago

ghost commented 6 years ago

Good evening,

i have a running testing-environment for use with mailcow and NextCloud. I was faced with an error mentioned here. Now that this error is "fixed" i'm getting watchdog-notifications every about 15 minutes.

Output of docker-compose logs -f php-fpm-mailcow is:

php-fpm-mailcow_1 | [04-Mar-2018 22:28:32] NOTICE: fpm is running, pid 1 php-fpm-mailcow_1 | [04-Mar-2018 22:28:32] NOTICE: ready to handle connections php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:28:52 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:28:52 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:28:55 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:28:55 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:29:02 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:29:02 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:29:02] WARNING: [pool www] child 18 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:29:02] WARNING: [pool www] child 18 exited with code 1 after 7.044195 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:29:02] NOTICE: [pool www] child 19 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:29:02 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - admin 04/Mar/2018:22:29:32 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:29:35 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:29:35] WARNING: [pool www] child 20 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:29:35] WARNING: [pool www] child 20 exited with code 1 after 2.788148 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:29:35] NOTICE: [pool www] child 21 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:29:35 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:29:42 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:29:48 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:29:48 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:29:51 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:29:51 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:30:02 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:30:05 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:30:05] WARNING: [pool www] child 21 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:30:05] WARNING: [pool www] child 21 exited with code 1 after 30.726664 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:30:05] NOTICE: [pool www] child 22 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:30:05 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:30:17 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:30:17 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:30:24 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:30:24 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:30:30 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - admin 04/Mar/2018:22:30:35 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:30:53 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:30:53] WARNING: [pool www] child 22 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:30:53] WARNING: [pool www] child 22 exited with code 1 after 47.219145 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:30:53] NOTICE: [pool www] child 23 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:30:53 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:30:57 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:31:02 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:31:11 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:31:11 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - admin 04/Mar/2018:22:31:32 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:31:34 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:31:34] WARNING: [pool www] child 24 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:31:34] WARNING: [pool www] child 24 exited with code 1 after 1.773225 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:31:34] NOTICE: [pool www] child 25 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:31:34 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:31:39 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:31:39 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:31:45 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:31:51 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:31:51 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:32:02 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:32:11 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:32:11] WARNING: [pool www] child 25 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:32:11] WARNING: [pool www] child 25 exited with code 1 after 37.333176 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:32:11] NOTICE: [pool www] child 26 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:32:11 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:32:16 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - admin 04/Mar/2018:22:32:32 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:32:37 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:32:37 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - ��T� 04/Mar/2018:22:32:47 +0000 "- " 200 php-fpm-mailcow_1 | [04-Mar-2018 22:32:47] WARNING: [pool www] child 27 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [04-Mar-2018 22:32:47] WARNING: [pool www] child 27 exited with code 1 after 15.364345 seconds from start php-fpm-mailcow_1 | [04-Mar-2018 22:32:47] NOTICE: [pool www] child 28 started php-fpm-mailcow_1 | 172.22.1.10 - 04/Mar/2018:22:32:47 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.8 - admin 04/Mar/2018:22:33:02 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.8 - 04/Mar/2018:22:33:09 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::1 - 04/Mar/2018:22:33:09 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | [04-Mar-2018 22:33:24] NOTICE: Terminating ... php-fpm-mailcow_1 | [04-Mar-2018 22:33:24] ERROR: unable to read what child say: Bad file descriptor (9) php-fpm-mailcow_1 | [04-Mar-2018 22:33:24] ERROR: unable to read what child say: Bad file descriptor (9) php-fpm-mailcow_1 | [04-Mar-2018 22:33:24] NOTICE: exiting, bye-bye!

Is there a connection between NextCloud and php-fpm since i have two other mailcow-system where NextCloud is not part of these systems and hence this error does not show?

Thanks :-)

ghost commented 6 years ago

It seems that this error is connected to the NextCloud sync-client. Yesterday i forgot to check the option that my sync-client should start at system start. In the time between sync-client being inactive, there was no error. After starting sync-client the error occurs periodicaly.

andryyy commented 6 years ago

Seems to be related to opcache. Can you try to set image: mailcow/phpfpm:1.13 in docker-compose.yml and run up -d? It is an image with PHP 7.2.

ghost commented 6 years ago

Hmmm, strange things are happening ...

root@devel:/opt/mailcow-dockerized# docker-compose up -d Building php-fpm-mailcow Step 1/11 : FROM php:7.1-fpm-alpine ---> c5cd2a6a43ed Step 2/11 : LABEL maintainer "Andre Peters andre.peters@servercow.de" ---> Using cache ---> 54c962007092 Step 3/11 : ENV REDIS_PECL 3.1.6 ---> Using cache ---> 9c48eb53fbaf Step 4/11 : ENV MEMCACHED_PECL 3.0.4 ---> Using cache ---> e38c2c6bcb6d Step 5/11 : ENV APCU_PECL 5.1.9 ---> Using cache ---> bf2799809a53 Step 6/11 : ENV IMAGICK_PECL 3.4.3 ---> Using cache ---> 73fa7cb03da2 Step 7/11 : ENV MAILPARSE_PECL 3.0.2 ---> Using cache ---> d48b4bd8e249 Step 8/11 : RUN apk add -U --no-cache libxml2-dev icu-dev imap-dev libmemcached-dev cyrus-sasl-dev pcre-dev icu-libs redis mysql-client bash autoconf g++ make openssl openssl-dev samba-client libpng libpng-dev libjpeg-turbo-dev libwebp-dev zlib-dev libxpm-dev c-client imagemagick-dev imagemagick libtool freetype libpng libjpeg-turbo freetype-dev libpng-dev libjpeg-turbo-dev gettext-dev openldap-dev librsvg && pear install channel://pear.php.net/Net_IDNA2-0.2.0 channel://pear.php.net/Auth_SASL-1.1.0 Net_IMAP Net_Sieve NET_SMTP Mail_mime && pecl install redis-${REDIS_PECL} memcached-${MEMCACHED_PECL} APCu-${APCU_PECL} imagick-${IMAGICK_PECL} mailparse-${MAILPARSE_PECL} && docker-php-ext-enable redis apcu memcached imagick mailparse && pecl clear-cache && docker-php-ext-configure intl && docker-php-ext-configure gd --with-gd --enable-gd-native-ttf --with-freetype-dir=/usr/include/ --with-png-dir=/usr/include/ --with-jpeg-dir=/usr/include/ && docker-php-ext-install -j 4 intl gettext ldap sockets soap pdo pdo_mysql xmlrpc gd zip pcntl opcache && docker-php-ext-configure imap --with-imap --with-imap-ssl && docker-php-ext-install -j 4 imap && apk del --purge autoconf g++ make libxml2-dev icu-dev imap-dev openssl-dev cyrus-sasl-dev pcre-dev libpng-dev libpng-dev libjpeg-turbo-dev libwebp-dev zlib-dev imagemagick-dev freetype-dev libpng-dev libjpeg-turbo-dev ---> Running in 743f07255bcb ERROR: Service 'php-fpm-mailcow' failed to build: connection error: desc = "transport: dial unix /var/run/docker/containerd/docker-containerd.sock: connect: connection refused"

ghost commented 6 years ago

@andryyy Thanks for your quick reaction :+1:

andryyy commented 6 years ago

Sorry, run docker-compose pull php-fpm-mailcow before running up -d.

But it looks like Docker was updated without deleting running containers. You may need to run docker-compose down followed by systemctl restart docker and docker-compose up -d. You can then proceed to add the new PHP image.

ghost commented 6 years ago

Ok, this did the trick :-)

docker-compose images shows this: mailcowdockerized_php-fpm-mailcow_1 mailcow/phpfpm 1.13 6b7ca71f5158 276 MB

Right now i'm not receiving any errors 👍

ghost commented 6 years ago

@andryyy Would it be good to set image: mailcow/phpfpm:1.13 as a standard value in mailcow-dockerized?

andryyy commented 6 years ago

I think about merging it, yes. 👍

ghost commented 6 years ago

Wonderful :-)

ghost commented 6 years ago

Unfortunately there is the error again ... Same log as above ...

But wait, here is the log from docker-compose logs -f php-fpm-mailcow

Attaching to mailcowdockerized_php-fpm-mailcow_1 php-fpm-mailcow_1 | mysqld is alive php-fpm-mailcow_1 | 0 php-fpm-mailcow_1 | [05-Mar-2018 11:54:41] NOTICE: fpm is running, pid 1 php-fpm-mailcow_1 | [05-Mar-2018 11:54:41] NOTICE: ready to handle connections php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:54:54 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:54:54 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:54:55 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:54:55 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:09 +0000 "GET /status.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:18 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:22 +0000 "GET /ocs/v1.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:24 +0000 "GET /ocs/v1.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:24 +0000 "GET /ocs/v2.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:24 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:40 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:55:47 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:55:52 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:56:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:56:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:56:46 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:56:46 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:56:50 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:56:50 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:57:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:57:30 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:57:35 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:57:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:58:07 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:58:26 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:58:26 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:58:28 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:58:28 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:58:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:59:05 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:59:07 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:59:08 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:59:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:59:50 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:59:50 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:11:59:53 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] WARNING: [pool www] child 40 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] WARNING: [pool www] child 40 exited with code 1 after 15.661170 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] NOTICE: [pool www] child 41 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:11:59:53 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:00:01 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:00:02 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:06 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:06 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:00:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:00:31 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:46 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:46 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:01:00 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:02 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - ��"�{ 05/Mar/2018:12:01:02 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] WARNING: [pool www] child 42 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] WARNING: [pool www] child 42 exited with code 1 after 15.924237 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] NOTICE: [pool www] child 43 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:02 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:08 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:08 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:15 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:15 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:01:32 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:01:36 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:40 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:01:43 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:12:01:52 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] WARNING: [pool www] child 43 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] WARNING: [pool www] child 43 exited with code 1 after 49.597904 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] NOTICE: [pool www] child 44 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:52 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:53 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:53 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:02:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:12:02:11 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] WARNING: [pool www] child 44 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:02:11 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] WARNING: [pool www] child 44 exited with code 1 after 19.395480 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] NOTICE: [pool www] child 45 started php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:02:34 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:02:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:02:39 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:02:39 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:43] NOTICE: Terminating ... php-fpm-mailcow_1 | [05-Mar-2018 12:02:43] NOTICE: exiting, bye-bye!

andryyy commented 6 years ago

Can you try to set opcache.enable=0 in data/conf/phpfpm/php-conf.d/opcache-recommended.ini, run docker-compose restart php-fpm-mailcow and check it again?

ghost commented 6 years ago

That's a done. Let's wait and see :-)

ghost commented 6 years ago

... and there is it again ... As i said before, every 10 - 15 minutes ..

Log:

Attaching to mailcowdockerized_php-fpm-mailcow_1 php-fpm-mailcow_1 | mysqld is alive php-fpm-mailcow_1 | 0 php-fpm-mailcow_1 | [05-Mar-2018 11:54:41] NOTICE: fpm is running, pid 1 php-fpm-mailcow_1 | [05-Mar-2018 11:54:41] NOTICE: ready to handle connections php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:54:54 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:54:54 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:54:55 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:54:55 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:09 +0000 "GET /status.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:18 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:22 +0000 "GET /ocs/v1.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:24 +0000 "GET /ocs/v1.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:24 +0000 "GET /ocs/v2.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:55:24 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:55:40 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:55:47 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:55:52 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:56:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:56:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:56:46 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:56:46 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:56:50 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:56:50 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:57:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:57:30 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:57:35 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:57:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:58:07 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:58:26 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:58:26 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:58:28 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:58:28 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:58:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:59:05 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:11:59:07 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:59:08 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:11:59:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:11:59:50 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:11:59:50 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:11:59:53 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] WARNING: [pool www] child 40 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] WARNING: [pool www] child 40 exited with code 1 after 15.661170 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 11:59:53] NOTICE: [pool www] child 41 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:11:59:53 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:00:01 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:00:02 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:06 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:06 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:00:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:00:31 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:46 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:00:46 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:01:00 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:02 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - ��"�{ 05/Mar/2018:12:01:02 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] WARNING: [pool www] child 42 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] WARNING: [pool www] child 42 exited with code 1 after 15.924237 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:01:02] NOTICE: [pool www] child 43 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:02 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:08 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:08 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:15 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:15 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:01:32 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:01:36 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:40 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:01:43 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:12:01:52 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] WARNING: [pool www] child 43 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] WARNING: [pool www] child 43 exited with code 1 after 49.597904 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:01:52] NOTICE: [pool www] child 44 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:01:52 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:01:53 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:01:53 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:12:02:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.4 - �?՚{ 05/Mar/2018:12:02:11 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] WARNING: [pool www] child 44 said into stderr: "zend_mm_heap corrupted" php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:12:02:11 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] WARNING: [pool www] child 44 exited with code 1 after 19.395480 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 12:02:11] NOTICE: [pool www] child 45 started php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:02:34 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:12:02:38 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:12:02:39 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:12:02:39 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | [05-Mar-2018 12:02:43] NOTICE: Terminating ... php-fpm-mailcow_1 | [05-Mar-2018 12:02:43] NOTICE: exiting, bye-bye!

andryyy commented 6 years ago

opcache should be disabled now. Please try grep -ir opcache *, do you see any other occurence? Please also set opcache.enable_cli to 0 and restart PHP. Settings USE_ZEND_ALLOC=0 as environment variable in docker-compose.yml for PHP is another way to disable it.

Maybe it is not able to allocate enough RAM and fails? You may try to set opcache settings like...

opcache.max_accelerated_files=1000
opcache.memory_consumption=32

...and retry before disabling it alltogether.

ghost commented 6 years ago

I think you are right.

Using grep -ir opcache * displays this message;

The PHP OPcache is not properly configured. For better performance it is recommended to use the following settings in the php.ini opcache.enable=1 opcache.enable_cli=1 opcache.interned_strings_buffer=8 opcache.max_accelerated_files=10000 opcache.memory_consumption=128 opcache.save_comments=1 opcache.revalidate_freq=1

I'l give this a try :-)

ghost commented 6 years ago

Ok, my fault ... I use tabs in docker-compose.yml

Using USE_ZEND_ALLOC=0 as environment variable shows same error.

ghost commented 6 years ago

I tried different Options but error persists But looking at docker-compose logs -f php-fpm-mailcow:

php-fpm-mailcow_1 | mysqld is alive php-fpm-mailcow_1 | 0 php-fpm-mailcow_1 | [05-Mar-2018 14:33:02] NOTICE: fpm is running, pid 1 php-fpm-mailcow_1 | [05-Mar-2018 14:33:02] NOTICE: ready to handle connections php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:14:33:06 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:14:33:06 +0000 "- " 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:14:33:07 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:14:33:07 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.4 - 0D~�U 05/Mar/2018:14:33:20 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 14:33:20] WARNING: [pool www] child 17 exited on signal 11 (SIGSEGV) after 14.414680 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 14:33:20] NOTICE: [pool www] child 18 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:14:33:20 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:14:33:31 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:14:33:32 +0000 "GET /settings.php" 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:14:33:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:14:33:44 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:14:33:44 +0000 "GET /forwardinghosts.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - ��~�U 05/Mar/2018:14:33:57 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 14:33:57] WARNING: [pool www] child 18 exited on signal 11 (SIGSEGV) after 37.080498 seconds from start php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:14:33:57 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 14:33:57] NOTICE: [pool www] child 19 started php-fpm-mailcow_1 | 172.22.1.10 - admin 05/Mar/2018:14:34:08 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - 05/Mar/2018:14:34:22 +0000 "HEAD /settings.php" 200 php-fpm-mailcow_1 | 172.22.1.4 - ��~�U 05/Mar/2018:14:34:28 +0000 "- " 200 php-fpm-mailcow_1 | [05-Mar-2018 14:34:28] WARNING: [pool www] child 19 exited on signal 11 (SIGSEGV) after 30.781759 seconds from start php-fpm-mailcow_1 | [05-Mar-2018 14:34:28] NOTICE: [pool www] child 20 started php-fpm-mailcow_1 | 172.22.1.4 - 05/Mar/2018:14:34:28 +0000 "- " 200 php-fpm-mailcow_1 | fd4d:6169:6c63:6f77::d - admin 05/Mar/2018:14:34:37 +0000 "PROPFIND /remote.php" 207 php-fpm-mailcow_1 | 172.22.1.10 - 05/Mar/2018:14:34:43 +0000 "HEAD /forwardinghosts.php" 200 php-fpm-mailcow_1 | [05-Mar-2018 14:34:53] NOTICE: Terminating ... php-fpm-mailcow_1 | [05-Mar-2018 14:34:53] NOTICE: exiting, bye-bye!

shows that entry zend_mm_heap corrupted has gone.

Changes in docker-compose.yml:

php-fpm-mailcow: ... environment:

and in data/conf/phpfpm/php-conf.d/opcache-recommended.ini

opcache.enable=0 opcache.enable_cli=0 opcache.interned_strings_buffer=8 opcache.max_accelerated_files=1000 opcache.memory_consumption=32 opcache.save_comments=1 opcache.revalidate_freq=1

andryyy commented 6 years ago

Can you post a dump of phpinfo()? Just put <?=phpinfo();?> in a new file in data/web and open it.

You will need to check your Nextcloud logs. What does NC process when this error happens? Why did grep find opcache.enable=1?

andryyy commented 6 years ago

Can you please also try setting pm.max_children = 400 in data/conf/phpfpm/php-fpm.d/www.conf? Restart PHP afterwards.

andryyy commented 6 years ago

I can finally reproduce it. :-) Will fix it soon.

ghost commented 6 years ago

@andryyy 👍 I really appreciate this. Three cheers and a tiger! 🥇

phipag commented 6 years ago

Have the same problem, thanks for fixing it.

ghost commented 6 years ago

A log time went by and i was busy with other things. Is there some kind of progress being made to this error?

andryyy commented 6 years ago

It should be fixed with yesterdays changes.

ghost commented 6 years ago

@andryyy Very well done 👍 I installed NextCloud, synced some files without any errors. I really appreciate your work

But let me ask one last question: Is there a way to install more than one NextCloud with the helper-script?

andryyy commented 6 years ago

Cool! :-)

Not yet, but we can think about it.

ghost commented 6 years ago

That would be very cool 👍 But i think it ist possible by changing some values in the helper-script? I will give it a try :-)

ghost commented 6 years ago

Thanks a lot for your help. Error is solved. I'm closing this issue.