mailcow / mailcow-dockerized

mailcow: dockerized - ๐Ÿฎ + ๐Ÿ‹ = ๐Ÿ’•
https://mailcow.email
GNU General Public License v3.0
8.97k stars 1.18k forks source link

Mailcow admin ui (/debug) empty after update #5927

Closed SwissOS closed 4 months ago

SwissOS commented 4 months ago

Contribution guidelines

I've found a bug and checked that ...

Description

I have a very similar problem to https://github.com/mailcow/mailcow-dockerized/issues/5024
As per issue 5024, my TZ is correct in mailcow.conf (TZ=Europe/Zurich)

I just updated to the June 2024 version and now I can no longer see the system/information (/debug) page. I get an empty page. The server works (SoGO is functional) but when I go to /admin, I get this error:

An unknown error occured: TypeError Object( [message:protected] => Cannot access offset of type string on string [string:Error:private] => [code:protected] => 0 [file:protected] => /web/debug.php [line:protected] => 32 [trace:Error:private] => Array ( ) [previous:Error:private] => )

This seems like a PHP error from my googling. I don't know where to look further though. Any pointers?


### Logs:

```plain text
I don't see any particular errors in the nginx docker log. /debug has return code 200, all good:

[28/Jun/2024:10:02:49 +0200] "GET /debug HTTP/1.1" 200 31 "https://webmail.domain.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:127.0) Gecko/20100101 Firefox/127.0"

Steps to reproduce:

Updated with update.sh this morning to latest version
Go to webmail page, login, get redirected to domain.com/debug but no page is shown.

Which branch are you using?

master

Which architecture are you using?

ARM64 (aarch64)

Operating System:

Ubuntu 22.04

Server/VM specifications:

24GB/4 cores

Is Apparmor, SELinux or similar active?

no

Virtualization technology:

none

Docker version:

27.02

docker-compose version or docker compose version:

2.28.1

mailcow version:

2024-06a

Reverse proxy:

Nginx (proxy_pass http://mailcowdockerized-nginx-mailcow-1:8080)

Logs of git diff:

way too long, but not the issue (didn't change the code).
The only change I added was my hostname to extra.cf in Postfix.
Mail server still works perfectly, it's just a webpage issue (/debug).

Logs of iptables -L -vn:

way too long, but not the issue

Logs of ip6tables -L -vn:

way too long, but not the issue

Logs of iptables -L -vn -t nat:

way too long, but not the issue

Logs of ip6tables -L -vn -t nat:

way too long, but not the issue

DNS check:

172.64.155.249
104.18.32.7
Niroda commented 4 months ago

Same ..

MrBridgefarm commented 4 months ago

Login to the admin panel, show's only a white page on the debug page. Then you change the link to /admin it shows errors.. An unknown error occured: TypeError Object( [message:protected] => Cannot access offset of type string on string [string:Error:private] => [code:protected] => 0 [file:protected] => /web/debug.php [line:protected] => 32 [trace:Error:private] => Array ( ) [previous:Error:private] => ) image

i've tried to re-install, no backup. Plain install on arm64 (Oracle) same error.

milkmaker commented 4 months ago

THIS IS A AUTOMATED MESSAGE!

It seems your issue is not a bug. Therefore we highly advise you to get support!

You can get support either by:

This issue will be closed. If you think your reported issue is not a support case feel free to comment above and if so the issue will reopened.

SwissOS commented 4 months ago

"It seems your issue is not a bug." If it's not a bug, then what is it?

I had a perfectly working mailcow, did an update this morning and it stopped working. Is that not a bug?

It's not like I tried to add some extra feature or something else; I am not asking for "support". I see other people have the same problem, so obviously not a lone case.

Try to install it new on an Oracle ARM64 VM and report back if it works? You can get a free account, so you don't need to spend anything.

MrBridgefarm commented 4 months ago

I don't get it, it was working fine on 24.04 but it's broken on 24.06 So it's clearly a big. As SWISSOS says try to install it on a arm64

I've installed it on a complete new vn on oracle no reverse proxy. Still same error. Arm is broken

psonntag1 commented 4 months ago

I have the same issue on one of my machines after update to the latest stable version. Logging in with an admin account, the /debug page is empty and /admin shows the array error. If I login with a normal user account the GUI works just fine.

psonntag1 commented 4 months ago

I narrowed it down a bit:

After switching on DEV_MODE for php_fpm_mailcow in docker-compose.yml I get the following error after login: Fatal error: Uncaught TypeError: Cannot access offset of type string on string in /web/debug.php:32 Stack trace: #0 {main} thrown in /web/debug.php on line 32

With adding a echo in debug.php date_default_timezone_set('UTC'); -->> echo $container_info; $StartedAt = date_parse($container_info['State']['StartedAt']);

I receive the following hint: Failed to connect to dockerapi port 443 after 14 ms: Couldn't connect to server Fatal error: Uncaught TypeError: Cannot access offset of type string on string in /web/debug.php:33 Stack trace: #0 {main} thrown in /web/debug.php on line 33

So, connecting to the dockerapi container fails. Currently I have no idea why that happens.

A workaround is to comment the whole container block (line 26-54) in data/web/debug.php.

@DerLinkman I like to ask you to reevaluate your opinion regarding bug/support.

esackbauer commented 4 months ago

That sounds for me that something that was hot-fixed in 2024-06 broke the dockerapi integration: https://github.com/mailcow/mailcow-dockerized/issues/5924#issuecomment-2195095580 Maybe containers for ARM and x86 are a little different?

Magelo commented 4 months ago

After the june update, when you visit https://mailcow.url, it redirects you to https://mailcow.url/debug, which displays a blank page. However, if you manually replace /debug with /admin, you gain access to the configuration settings but not the desired information page.

psonntag1 commented 4 months ago

In my case I was able to resolve the issue by removing the "search" option in /etc/resolv.conf

Magelo commented 4 months ago

Removing "search" in /etc/resolv.conf is not working for me.

trying multiple refresh of https://mailcow.url/debug, then replace debug by admin I see this:

An unknown error occured: TypeError Object( [message:protected] => Cannot access offset of type string on string [string:Error:private] => [code:protected] => 0 [file:protected] => /web/debug.php [line:protected] => 32 [trace:Error:private] => Array ( ) [previous:Error:private] => )

Callahan78 commented 4 months ago

same here after udate to 2024-06a Iยดve rolled back for now and hope that a solution can be found

mendozal commented 4 months ago

I have the same situation on an ARM machine on Oracle Cloud. Same blank page and error message. It only started to happened after the 2024-06 update.

I temporarily moved to an x86 machine and it's working fine there.

sergedc commented 4 months ago

Same here on ARM machine on Oracle Cloud

If I add in debug.php: echo โ€œContainer Info: โ€; print_r($container_info); // Print the entire container_info array for debugging

I get: "Container Info: Could not resolve host: dockerapi"

lpwoodhouse commented 4 months ago

Worked perfectly fine on v2023-12 but I am getting the exact same issue when I upgrade to 2024-06a OS Dist: x86 RHEL 8.10

webdev4u commented 4 months ago

In docker-compose.yml changed from image: mailcow/phpfpm:1.88 to image: mailcow/phpfpm:1.87 in php-fpm-mailcow service, than run docker compose up -d --no-deps --build and page is working again.

DerLinkman commented 4 months ago

I get: "Container Info: Could not resolve host: dockerapi"

Still with the new 1.88 php-fpm image? A repull (docker compose pull) and a restart (docker compose up -d) is needed.

DerLinkman commented 4 months ago

@SwissOS Did your installation use IPv6? If not: Properly disabled like described here: https://docs.mailcow.email/post_installation/firststeps-disable_ipv6

SwissOS commented 4 months ago

Yes, it uses IPv6

vineethmn commented 4 months ago

Disabled : IPv6 --> Not Solved Disabled: Search option in resolve.conf --> Not Solved Revert the phpfpm version from phpfpm:1.88 to phpfpm:1.87 --> fixed the issue

DerLinkman commented 4 months ago

Sooo... i've rebuild the php container on Debian 12 instead of Alpine 3.20 and reopened the ticket at Alpines Aport repo: https://gitlab.alpinelinux.org/alpine/aports/-/issues/15690

If some one could test if this issue is fixed on phpfpm:1.89 it would be muchly appreciated :)

rbrunka commented 4 months ago

phpfpm:1.87 works. thx.

MrBridgefarm commented 4 months ago

@DerLinkman i've testet et with phpfpm:1.89 on oracle with ubuntu a total clean install. and it works.

pcace commented 4 months ago

Disabled : IPv6 --> Not Solved Disabled: Search option in resolve.conf --> Not Solved Revert the phpfpm version from phpfpm:1.88 to phpfpm:1.87 --> fixed the issue

Hi, i think i am facing the same issue. how do i revert to that version?

thanks a lot!

DerLinkman commented 4 months ago

Closin it here as duplicate of https://github.com/mailcow/mailcow-dockerized/issues/5928

rbrunka commented 4 months ago

@pcace the quick and dirty way is here:


index 563144af..41d541b2 100644
--- a/docker-compose.yml
+++ b/docker-compose.yml
@@ -110,7 +110,7 @@ services:
             - rspamd

     php-fpm-mailcow:
-      image: mailcow/phpfpm:1.88
+      image: mailcow/phpfpm:1.87
       command: "php-fpm -d date.timezone=${TZ} -d expose_php=0"
       depends_on:
         - redis-mailcow```
Green2Matter commented 1 week ago

Exactly same behaviour after updating to 2024-11. After changing 1.91 to:

    php-fpm-mailcow:
      image: mailcow/phpfpm:1.90

it works as normal...

wrcno1 commented 5 days ago

Exactly same behaviour after updating to 2024-11. After changing 1.91 to:

    php-fpm-mailcow:
      image: mailcow/phpfpm:1.90

it works as normal...

It works for me

Magelo commented 5 days ago

Exactly same behaviour after updating to 2024-11. After changing 1.91 to:

    php-fpm-mailcow:
      image: mailcow/phpfpm:1.90

it works as normal...

Replacing phpfpm:1.91 with phpfpm:1.90 is working for me too.

apio-sys commented 5 days ago

I just upgraded my 2 instances to 2024-11 and didn't have any issue and no need to make the php-fpm modifications as suggested here. Maybe you have un underlying OS that doesn't support this? It shouldn't of course and even writing this I don't see how this can affect the U/G from working correctly... Anyway, for me, 1 instance on Ubuntu 22.04 and another on 24.04 upgraded just fine without any glitches.

PseudoResonance commented 5 days ago

It was working for me for some time, then it broke when I restarted to get new certificates and never came back no matter what I tried, on Ubuntu 24.04. Brand new install of Mailcow on a brand new 24.04 VM. I had to revert the php-fpm version too, but I'm still not sure what caused it in the first place.

henningsieh commented 5 days ago

In docker-compose.yml changed from image: mailcow/phpfpm:1.88 to image: mailcow/phpfpm:1.87 in php-fpm-mailcow service, than run docker compose up -d --no-deps --build and page is working again.

Hi, now we are a few updates later, we are at phpfpm:1.91:

    php-fpm-mailcow:
      image: mailcow/phpfpm:1.91
      command: "php-fpm -d date.timezone=${TZ} -d expose_php=0"
      depends_on:
        - redis-mailcow
      volumes:
        - ./data/hooks/phpfpm:/hooks:Z
        - ./data/web:/web:z
...

The error '/debug' empty after update after executing "update.sh" is still not fixed.

Does anyone have recommandations on this?

ajnadox commented 4 days ago

Editing /opt/mailcow-dockerized/docker-compose.yml and changing line: php-fpm-mailcow: image: mailcow/phpfpm:1.91 to php-fpm-mailcow: image: mailcow/phpfpm:1.90

then saving the file and running ./update.sh again fixed the issue for me.

DerLinkman commented 4 days ago

Only a workaround, we need to see what is causing this in the longrun. We cannot keep that forever as we miss os updates inside the container then. The plan is to release a bug fix update today which may fix this. As we cannot repro this anywere it is again, hard to debug....

henningsieh commented 4 days ago

Thanks for your response! Then I'll wait...

If I can help with my hetzner VPS machine, on which this has happened today morning, please let me know.

EinPinsel commented 3 days ago

@DerLinkman Is there anything in particular which we can provide you with to get the root cause of that issue?

DerLinkman commented 2 days ago

Nope i'm afraid not. We still don't know what is wrong there.

Maybe something dns related? Can you confirm that the 2024-11a is not fixing the issue for you? Ideally is, that all running docker containers in some kind allocated to mailcow are displayed in the debug page.

ajnadox commented 2 days ago

just tested 2024-11a and it fixed the issue for me, running phpfpm:1.91.1 now. Thanks!

henningsieh commented 1 day ago

Can you confirm that the 2024-11a is not fixing the issue for you?

I can confirm the opposite.

just tested 2024-11a and it fixed the issue for me, running phpfpm:1.91.1 now. Thanks!

same for me here... ๐ŸŽ‰

I've executed /opt/mailcow-dockerized/update.sh today morning and everything is back working just fine!

-- Just in case anyone wants to dig into this... here is my output, the solution must be included somewhere in any of the updated images. But anyway... many thanks @DerLinkman ๐Ÿ™

update.sh console output ```root@ubuntu-8gb-nbg1-1:/opt/mailcow-dockerized# ./update.sh Detecting if your IP is listed on Spamhaus Bad ASN List... Check completed! Your IP is clean Checking internet connection... OK Detecting which build your mailcow runs on... You are receiving stable updates (master). To change that run the update.sh Script one time with the --nightly parameter to switch to nightly builds. Checking for newer update script... Updated 0 paths from a1586f47 Are you sure you want to update mailcow: dockerized? All containers will be stopped. [y/N] y Great! Native IPv6 NAT is active. Validating docker-compose stack configuration... Checking for conflicting bridges... Saving diff to update_diffs/diff_before_update_2024-11-14-07-50-39... Prefetching images... 1.23: Pulling from mailcow/unbound Digest: sha256:161135ce3a3165430455e6191a5f88d9d9faab9f0c6b49689e0cd84f4fe98882 Status: Image is up to date for mailcow/unbound:1.23 docker.io/mailcow/unbound:1.23 10.5: Pulling from library/mariadb Digest: sha256:575327d46f436430330e363aa151d34e730fa5e94d85e5effa87cc960714d1b7 Status: Image is up to date for mariadb:10.5 docker.io/library/mariadb:10.5 7-alpine: Pulling from library/redis da9db072f522: Pull complete dd8d46bd4047: Pull complete 5057e26f1a86: Pull complete be83d0fd33a3: Pull complete b3d150cb1b6c: Pull complete 369ad5b9119b: Pull complete 4f4fb700ef54: Pull complete 37d63ae71d35: Pull complete Digest: sha256:c1e88455c85225310bbea54816e9c3f4b5295815e6dbf80c34d40afc6df28275 Status: Downloaded newer image for redis:7-alpine docker.io/library/redis:7-alpine 1.66: Pulling from mailcow/clamd Digest: sha256:39165e03bda2be5b2ae6a7809e1ef556413274077b53f61d0eae3f7690ff06d2 Status: Image is up to date for mailcow/clamd:1.66 docker.io/mailcow/clamd:1.66 1.98: Pulling from mailcow/rspamd Digest: sha256:5d4a987ca6b5c8c1490292674210e80dc43b809604c55cecb1c9f383f9ab95e3 Status: Image is up to date for mailcow/rspamd:1.98 docker.io/mailcow/rspamd:1.98 1.91.1: Pulling from mailcow/phpfpm 43c4264eed91: Already exists d96c133c922f: Pull complete 0a48dc562ccf: Pull complete d14b83920600: Pull complete ceb8dbd39ff5: Pull complete ecbefb292325: Pull complete d6c975d8003e: Pull complete a153f77c1fbc: Pull complete d8d809165e09: Pull complete 4f4fb700ef54: Pull complete 0e8ca7d8e061: Pull complete 7d9f06821643: Pull complete 05d5dc0537c5: Pull complete Digest: sha256:dc287189f11b784f842f068e93513b96c512afe0afb1f2f6aa258d2e33655250 Status: Downloaded newer image for mailcow/phpfpm:1.91.1 docker.io/mailcow/phpfpm:1.91.1 1.127.1: Pulling from mailcow/sogo a480a496ba95: Already exists 2edebee26665: Pull complete 48ee54b3fef7: Pull complete 8fd8a8c4288d: Pull complete 579bf6a0cd16: Pull complete 106695d59c36: Pull complete cae52fc6b629: Pull complete dee2cb815183: Pull complete a0aece1c6971: Pull complete 4f4fb700ef54: Pull complete Digest: sha256:4be6e90e0e062a829528f49abd080ca5dec25c09e1bfb07e2e45a88454d44775 Status: Downloaded newer image for mailcow/sogo:1.127.1 docker.io/mailcow/sogo:1.127.1 2.2: Pulling from mailcow/dovecot Digest: sha256:139ddc64f8440902c6b94cd0a2d6afa3ba0cb5620d2d4e7d1befab1c2bf8e1bd Status: Image is up to date for mailcow/dovecot:2.2 docker.io/mailcow/dovecot:2.2 1.77: Pulling from mailcow/postfix Digest: sha256:6a11ac78bc3efb87e1a3e9457158a5eddd55078dae6e86e4de64d9619665fc93 Status: Image is up to date for mailcow/postfix:1.77 docker.io/mailcow/postfix:1.77 alpine: Pulling from library/memcached da9db072f522: Already exists 2e3b6576f815: Pull complete 2202fa40ee71: Pull complete 71274c22921f: Pull complete 0a9ba9502499: Pull complete ac6cb5025e1a: Pull complete Digest: sha256:ea00dea6ae97e8c47dca9ef0a06c96381f4bdb8c7dd46aa03090de67aa8dd051 Status: Downloaded newer image for memcached:alpine docker.io/library/memcached:alpine mainline-alpine: Pulling from library/nginx da9db072f522: Already exists 795a89dcc4f0: Pull complete 9ad567d3b8a2: Pull complete 85e8836903ab: Pull complete 276e8818f0df: Pull complete 20212ccf8a7a: Pull complete 3917e8bc7be0: Pull complete bcf46b1b1b14: Pull complete Digest: sha256:74175cf34632e88c6cfe206897cbfe2d2fecf9bf033c40e7f9775a3689e8adc7 Status: Downloaded newer image for nginx:mainline-alpine docker.io/library/nginx:mainline-alpine 1.90: Pulling from mailcow/acme Digest: sha256:ef179d719dd752c89948a619a6f71e9b7cae54b53f237d7285ca1f64daa01e39 Status: Image is up to date for mailcow/acme:1.90 docker.io/mailcow/acme:1.90 1.59: Pulling from mailcow/netfilter Digest: sha256:f2b5a92a2d8eef1011e239b6ead4f6379b1e4d196e9c5c55470514b5a07b7eaa Status: Image is up to date for mailcow/netfilter:1.59 docker.io/mailcow/netfilter:1.59 2.05: Pulling from mailcow/watchdog Digest: sha256:f045e502a97db78691fe817476e713b0655c0a941ab0b0f042dcfde4b666a360 Status: Image is up to date for mailcow/watchdog:2.05 docker.io/mailcow/watchdog:2.05 2.09: Pulling from mailcow/dockerapi Digest: sha256:6ba2c0b2fc71683136558a58818b29b6164958ad5ca74855aaf577f0c7877baf Status: Image is up to date for mailcow/dockerapi:2.09 docker.io/mailcow/dockerapi:2.09 1.8.3: Pulling from mailcow/solr Digest: sha256:102ba2b9dafaf9fd3b6454d1b9f6cac8fd31c2ce1c584c5102075d8f0af6f16d Status: Image is up to date for mailcow/solr:1.8.3 docker.io/mailcow/solr:1.8.3 1.13: Pulling from mailcow/olefy Digest: sha256:7af3077336fa79978dfffef76af1eee37a4befe7df4c6fdd6aed7753e86b466b Status: Image is up to date for mailcow/olefy:1.13 docker.io/mailcow/olefy:1.13 latest: Pulling from mcuadros/ofelia Digest: sha256:5dbbf5378f65a43c49859bc6342cbec4a13fabd0474ad7398d6d906181fb7529 Status: Image is up to date for mcuadros/ofelia:latest docker.io/mcuadros/ofelia:latest Stopping mailcow... [+] Running 19/19 โœ” Container mailcowdockerized-watchdog-mailcow-1 Removed 1.2s โœ” Container mailcowdockerized-olefy-mailcow-1 Removed 10.5s โœ” Container mailcowdockerized-memcached-mailcow-1 Removed 2.0s โœ” Container mailcowdockerized-dockerapi-mailcow-1 Removed 3.0s โœ” Container mailcowdockerized-rspamd-mailcow-1 Removed 30.5s โœ” Container mailcowdockerized-ofelia-mailcow-1 Removed 1.1s โœ” Container mailcowdockerized-solr-mailcow-1 Removed 2.9s โœ” Container mailcowdockerized-postfix-mailcow-1 Removed 2.5s โœ” Container mailcowdockerized-acme-mailcow-1 Removed 1.4s โœ” Container mailcowdockerized-nginx-mailcow-1 Removed 0.8s โœ” Container mailcowdockerized-php-fpm-mailcow-1 Removed 0.6s โœ” Container mailcowdockerized-sogo-mailcow-1 Removed 10.4s โœ” Container mailcowdockerized-redis-mailcow-1 Removed 0.6s โœ” Container mailcowdockerized-dovecot-mailcow-1 Removed 3.0s โœ” Container mailcowdockerized-clamd-mailcow-1 Removed 0.4s โœ” Container mailcowdockerized-mysql-mailcow-1 Removed 0.8s โœ” Container mailcowdockerized-netfilter-mailcow-1 Removed 0.3s โœ” Container mailcowdockerized-unbound-mailcow-1 Removed 3.1s โœ” Network mailcowdockerized_mailcow-network Removed 0.2s Checking for remaining containers... Committing current status... Fetching updated code from remote... Merging local with remote code (recursive, strategy: "theirs", options: "patience"... Auto-merging docker-compose.yml Merge made by the 'recursive' strategy. data/web/debug.php | 22 +++++++++++++--------- data/web/lang/lang.zh-cn.json | 145 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++---------------------- docker-compose.yml | 4 ++-- 3 files changed, 138 insertions(+), 33 deletions(-) Fetching new images, if any... [+] Pulling 18/18 โœ” postfix-mailcow Pulled 1.1s โœ” dockerapi-mailcow Pulled 1.1s โœ” sogo-mailcow Pulled 1.2s โœ” memcached-mailcow Pulled 1.2s โœ” watchdog-mailcow Pulled 1.2s โœ” dovecot-mailcow Pulled 1.2s โœ” clamd-mailcow Pulled 1.2s โœ” nginx-mailcow Pulled 1.2s โœ” unbound-mailcow Pulled 1.1s โœ” rspamd-mailcow Pulled 1.2s โœ” netfilter-mailcow Pulled 1.2s โœ” solr-mailcow Pulled 1.2s โœ” acme-mailcow Pulled 1.2s โœ” php-fpm-mailcow Pulled 1.2s โœ” ofelia-mailcow Pulled 1.2s โœ” mysql-mailcow Pulled 1.2s โœ” redis-mailcow Pulled 1.2s โœ” olefy-mailcow Pulled 1.2s Checking IPv6 settings... Starting mailcow... [+] Running 19/19 โœ” Network mailcowdockerized_mailcow-network Created 0.2s โœ” Container mailcowdockerized-olefy-mailcow-1 Started 3.0s โœ” Container mailcowdockerized-netfilter-mailcow-1 Started 1.4s โœ” Container mailcowdockerized-dockerapi-mailcow-1 Started 3.1s โœ” Container mailcowdockerized-unbound-mailcow-1 Healthy 33.3s โœ” Container mailcowdockerized-sogo-mailcow-1 Started 3.0s โœ” Container mailcowdockerized-memcached-mailcow-1 Started 3.2s โœ” Container mailcowdockerized-solr-mailcow-1 Started 3.6s โœ” Container mailcowdockerized-redis-mailcow-1 Started 3.6s โœ” Container mailcowdockerized-mysql-mailcow-1 Started 4.1s โœ” Container mailcowdockerized-clamd-mailcow-1 Started 34.2s โœ” Container mailcowdockerized-php-fpm-mailcow-1 Started 4.6s โœ” Container mailcowdockerized-dovecot-mailcow-1 Started 6.0s โœ” Container mailcowdockerized-postfix-mailcow-1 Started 34.3s โœ” Container mailcowdockerized-nginx-mailcow-1 Started 5.9s โœ” Container mailcowdockerized-ofelia-mailcow-1 Started 6.6s โœ” Container mailcowdockerized-rspamd-mailcow-1 Started 34.7s โœ” Container mailcowdockerized-acme-mailcow-1 Started 33.6s โœ” Container mailcowdockerized-watchdog-mailcow-1 Started 34.9s Collecting garbage... The following unused mailcow images were found: mailcow/backup:latest (1d4defb316cc) mailcow/sogo:1.127 (46a4d180acf6) mailcow/phpfpm:1.91 (a154e466b227) Do you want to delete them to free up some space? [y/N] y Untagged: mailcow/sogo:1.127 Untagged: mailcow/sogo@sha256:5a131262872d59b2b1a84ccc33776c530e2360c1d3cb9eaff51c4215c629e391 Deleted: sha256:46a4d180acf6648bbd1c256aa699ea0798fe0220369ede29a233b7eec4cf3178 Deleted: sha256:3679499fb33d7e35ade6ba377c9065fa94a98222fbb4474bb1528a0b07491d4c Deleted: sha256:b43f9f1f663b865cafe534f62231a89e73675f25ed2269b68ba77dbde9b940a9 Deleted: sha256:53f6fa474239c80627d7acb041878dd88bc81178936313566d634e0b846e143c Deleted: sha256:348436dbf4ba57ae14ec7fc9e3d716f7b86357063b806f0b399ba7b96f15fd35 Deleted: sha256:1701def3857f5863e85a9406fec1bb3135827f3361737044cb9b82e0ee567e4f Deleted: sha256:891188a49dc20a286421e1a1ea75a977840b089c17203f5f418ecd5e3a29eace Deleted: sha256:ea0e6ae9d07fb8231ab0ccced2d95ab4ee0072863ce4a5ad605cd30d0372bd71 Deleted: sha256:d84f820eecff2f1ce9cea1107f138123e4437fe512419c818c568735701dfbef Deleted: sha256:fd147aa6cf8312d0614ea944a0c26c4119c584f61147f5cc5c2cd2de578d356e Untagged: mailcow/phpfpm:1.91 Untagged: mailcow/phpfpm@sha256:ed0b144cb7cf5f8753519fadb785466e9bb02d891a121a7afeea2f26de5766b0 Deleted: sha256:a154e466b227f366764c848b6d2babded5d464f0c4806ddb801130b4f938125b Deleted: sha256:09c826afb3cfc4d4c9b0c01e802f62566cb9997fecf694769c30a3b0d3c8dd5b Deleted: sha256:f27430b669513d7841ddd273af8ec3dd2402f9fdde60c7dd9d29c252acc0fe50 Deleted: sha256:82e992cfa54f84587e10f71c1c8f45f802b3e773da33ecc48b392dd1595270bc Deleted: sha256:c34afd0ec454617dee455119d7c85e03a0e0ae3d2069c1a9f857d6724674ca12 Deleted: sha256:33826df544283a06a811ccc794d57aa61925c030a1eafe6c91f4864aa24dbf63 Deleted: sha256:46cb82d436d8c7abc6274c0e431b79cef898f4bad3d46b784cdd36f14b9da2c2 Deleted: sha256:b7bc43f664711ed0f80f962d84dc676d0134bec5f6c42f3b8d3e900309f89299 Deleted: sha256:4805950f33de8c3f7a97f522e91e7ab0a0bbfc14cb590f043aed541dd7803055 Deleted: sha256:90194a1e8ccee0a8f62c389910c35223807c186902e98ce1244cdae1970b4c49 Deleted: sha256:daa138833a10dd9e980cd99493f0c42f469b60ee79f164bfff149a2b6bf2e446 Deleted: sha256:fe93da1c3977142bc10ec3f7d6af0c8665e65cd165551f862a3a60e936c8a00e Error response from daemon: conflict: unable to delete 1d4defb316cc (cannot be forced) - image is being used by running container b6e386369856 Further cleanup... If you want to cleanup further garbage collected by Docker, please make sure all containers are up and running before cleaning your system by executing "docker system prune" root@ubuntu-8gb-nbg1-1:/opt/mailcow-dockerized# ```
DerLinkman commented 1 day ago

Just in case anyone wants to dig into this... here is my output, the solution must be included somewhere in any of the updates images.

Thanks... nothing new to me but i think it's because of the curl-dns module fix introduced in 1.91.1.

Does your dashboard looks normal now again?

henningsieh commented 1 day ago

dashboard looks normal now again?

yes!

grafik

DerLinkman commented 1 day ago

No i mean the lower half where all containers are presented.

henningsieh commented 1 day ago

the lower half where all containers are presented

also, yes!

grafik

DerLinkman commented 1 day ago

Huh ok. Then it's fixed.

EinPinsel commented 18 hours ago

Nope i'm afraid not. We still don't know what is wrong there.

Maybe something dns related? Can you confirm that the 2024-11a is not fixing the issue for you? Ideally is, that all running docker containers in some kind allocated to mailcow are displayed in the debug page.

For me the update to 11a fixed it, and I can see all the containers. Good for me, bad for the root cause analysis :/