Open 53c70r opened 1 year ago
How are you configuring EWS? SOGo (as part of mailcow) only supports EAS, and (to my knowledge) iOS doesn't support EWS for Active Sync either.
What should I provide for further analysis? The CPU Load really gets out of hand at this pint. About 12% for each IOS device.
I think I might have the same issue. Logs also looks very similar. If I can provide something for analysis, let me know.
Same here, I am experiencing the same behavior with about 12% CPU load per iOS device. Also happy to provide additional infos and logs on request.
Same here. 150-200% CPU load on cloud server. Continuous dovecot (IMAP) logins.
Fixed for me after running ./update.sh
and upgrading to v 2023-4b (which includes SOGo 1.8.1)
I can't confirm that it is fixed in 2023-4b.
Here is the same ... An IOS client causes in the log of Dovecot without end entries and an extremely high processor load with the service "dovecot /auth -w".
After a restart of Sogo it is back to normal for 30-60 minutes. But after the time I have the same symptoms
Fixed for me after running
./update.sh
and upgrading to v 2023-4b (which includes SOGo 1.8.1)
I was premature in saying this, @53c70r and @simatec are right, it is NOT fixed and I still have the same symptoms.
This issue is also discussed at mailcow community. https://community.mailcow.email/d/1927-update-to-ios16-drains-battery-flooding-mailow-logs/11
I have the same problem with all iOS devices connected to SoGO, I have constantly around 30% CPU with 3 iOS devices and up to 1GB additional traffic per day because of this issue.
I tried the workaround with copying one email into the Templates folder mentioned here, but it doesn't seem to change anything. https://bugs.sogo.nu/view.php?id=5626#c16323
It seems that I found the cause of my issue. It was a shared mailbox I had in my account, the folder Shared/email@domain.tld
caused the syncing issues. After removing the shared folder, the sync issues went away.
I enabled the SOGoEASDebugEnabled = YES
(in sogo.conf) like mentioned here: https://community.mailcow.email/d/1927-update-to-ios16-drains-battery-flooding-mailow-logs/11
Then I saw a lot of log messages like in this comment, inside the <CollectionId>mail%2FTemplates</CollectionId>
I didn't have the Templates folder, it was mail%2FShared[...]
instead. So that caused me to try removing the shared folder.
This seems like another SoGO EAS bug, if I have some time I will try to open an issue in their bug tracker.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
further activity.
further activity.
It's probably a SoGO bug and not really mailcow related. I didn't figure out how to report a bug to SoGO, maybe that would be a good next step.
further activity.
It's probably a SoGO bug and not really mailcow related. I didn't figure out how to report a bug to SoGO, maybe that would be a good next step.
I have the same issue. Only from iOS devices connecting via ActiveSync.
It seems that I found the cause of my issue. It was a shared mailbox I had in my account, the folder
Shared/email@domain.tld
caused the syncing issues. After removing the shared folder, the sync issues went away.How I found it:
I enabled the
SOGoEASDebugEnabled = YES
(in sogo.conf) like mentioned here: https://community.mailcow.email/d/1927-update-to-ios16-drains-battery-flooding-mailow-logs/11Then I saw a lot of log messages like in this comment, inside the
<CollectionId>mail%2FTemplates</CollectionId>
I didn't have the Templates folder, it wasmail%2FShared[...]
instead. So that caused me to try removing the shared folder.This seems like another SoGO EAS bug, if I have some time I will try to open an issue in their bug tracker.
It's exactly the same issue for me, not the Template but the Shared folder.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
I'm still having this problem as well, showed up after iOS 16 came out over a year ago. I did get logs last time, it was similar to the error above but wasn't the Shared or Templates folder. I'll comment once it happens again with logs as I didnt save it.
Just had it happen again, here's logs, essentially it just keeps spamming until I restart sogo container. I've redacted sensitive/personal information. You can also see the active-sync endpoint getting spammed in nginx logs. It may be the same error as mentioned here on sogo's bug tracker.
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 syslog-ng[8]: Error processing log message: <!DOCTYPE ActiveSync PUBLIC "-//MICROSOFT//DTD ActiveSync//EN" "http://www.microsoft.com/">
sogo-mailcow-1 | <Sync xmlns="AirSync:">
sogo-mailcow-1 | <Collections>
sogo-mailcow-1 | <Collection>
sogo-mailcow-1 | <SyncKey>9688-17530</SyncKey>
sogo-mailcow-1 | <CollectionId>mail%2F2a089701d5e4d25e557b00003eb6cc59</CollectionId>
sogo-mailcow-1 | <GetChanges>0</GetChanges>
sogo-mailcow-1 | <Options>
sogo-mailcow-1 | <FilterType>5</FilterType>
sogo-mailcow-1 | <Conflict>0</Conflict>
sogo-mailcow-1 | <BodyPreference xmlns="AirSyncBase:">
sogo-mailcow-1 | <Type>4</Type>
sogo-mailcow-1 | </BodyPreference>
sogo-mailcow-1 | </Options>
sogo-mailcow-1 | <Commands>
sogo-mailcow-1 | <Change>
sogo-mailcow-1 | <ServerId>9687</ServerId>
sogo-mailcow-1 | <ApplicationData>
sogo-mailcow-1 | <Read xmlns="Email:">1</Read>
sogo-mailcow-1 | </ApplicationData>
sogo-mailcow-1 | </Change>
sogo-mailcow-1 | </Commands>
sogo-mailcow-1 | </Collection>
sogo-mailcow-1 | </Collections>
sogo-mailcow-1 | </Sync>
sogo-mailcow-1 |
sogo-mailcow-1 | Go/Microsoft-Server-ActiveSync?User=<My Email>&DeviceId=<device id>&DeviceType=iPad&Cmd=Sync HTTP/1.0" 200 99/116 0.109 - - 24K - 12
sogo-mailcow-1 | - 12
sogo-mailcow-1 | -01-26T13:02:54.000Z</DateReceived>
sogo-mailcow-1 | <Importance xmlns="Email:">1</Importance>
sogo-mailcow-1 | <Read xmlns="Email:">0</Read>
sogo-mailcow-1 | <MessageClass xmlns="Email:">IPM.Note</MessageClass>
sogo-mailcow-1 | <ContentClass xmlns="Email:">urn:content-classes:message</ContentClass>
sogo-mailcow-1 | <Reply-To xmlns="Email:"><Sender Name> <<Sender Email>></Reply-To>
sogo-mailcow-1 | <InternetCPID xmlns="Email:">65001</InternetCPID>
sogo-mailcow-1 | <Body xmlns="AirSyncBase:">
sogo-mailcow-1 | <Type>1</Type>
sogo-mailcow-1 | <Truncated>0</Truncated>
sogo-mailcow-1 | <Preview/>
sogo-mailcow-1 | <Data>------------- REDACTED EMAIL CONTENT -------------------
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 syslog-ng[8]: Error processing log message: <Sync xmlns="AirSync:">
sogo-mailcow-1 | <Collections>
sogo-mailcow-1 | <Collection>
sogo-mailcow-1 | <SyncKey>9688-17530</SyncKey>
sogo-mailcow-1 | <CollectionId>mail%2F2a089701d5e4d25e557b00003eb6cc59</CollectionId>
sogo-mailcow-1 | <GetChanges>0</GetChanges>
sogo-mailcow-1 | <Options>
sogo-mailcow-1 | <FilterType>5</FilterType>
sogo-mailcow-1 | <Conflict>0</Conflict>
sogo-mailcow-1 | <BodyPreference xmlns="AirSyncBase:">
sogo-mailcow-1 | <Type>4</Type>
sogo-mailcow-1 | </BodyPreference>
sogo-mailcow-1 | </Options>
sogo-mailcow-1 | <Commands>
sogo-mailcow-1 | <Change>
sogo-mailcow-1 | <ServerId>9687</ServerId>
sogo-mailcow-1 | <ApplicationData>
sogo-mailcow-1 | <Read xmlns="Email:">1</Read>
sogo-mailcow-1 | </ApplicationData>
sogo-mailcow-1 | </Change>
sogo-mailcow-1 | </Commands>
sogo-mailcow-1 | </Collection>
sogo-mailcow-1 | </Collections>
sogo-mailcow-1 | </Sync>
sogo-mailcow-1 |
sogo-mailcow-1 | Go/Microsoft-Server-ActiveSync?User=<My Email>&DeviceId=<device id>&DeviceType=iPad&Cmd=Sync HTTP/1.0" 200 99/116 0.109 - - 24K - 12
sogo-mailcow-1 | - 12
sogo-mailcow-1 | -01-26T13:02:54.000Z</DateReceived>
sogo-mailcow-1 | <Importance xmlns="Email:">1</Importance>
sogo-mailcow-1 | <Read xmlns="Email:">0</Read>
sogo-mailcow-1 | <MessageClass xmlns="Email:">IPM.Note</MessageClass>
sogo-mailcow-1 | <ContentClass xmlns="Email:">urn:content-classes:message</ContentClass>
sogo-mailcow-1 | <Reply-To xmlns="Email:"><Sender Name> <X></Reply-To>
sogo-mailcow-1 | <InternetCPID xmlns="Email:">65001</InternetCPID>
sogo-mailcow-1 | <Body xmlns="AirSyncBase:">
sogo-mailcow-1 | <Type>1</Type>
sogo-mailcow-1 | <Truncated>0</Truncated>
sogo-mailcow-1 | <Preview/>
sogo-mailcow-1 | <Data>------------- REDACTED EMAIL CONTENT -------------------
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Collections>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Collection>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <SyncKey>9688-17530</SyncKey>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <CollectionId>mail%2F2a089701d5e4d25e557b00003eb6cc59</CollectionId>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <GetChanges>0</GetChanges>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Options>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <FilterType>5</FilterType>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Conflict>0</Conflict>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <BodyPreference xmlns="AirSyncBase:">
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Type>4</Type>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </BodyPreference>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </Options>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Commands>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Change>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <ServerId>9687</ServerId>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <ApplicationData>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 <Read xmlns="Email:">1</Read>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </ApplicationData>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </Change>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </Commands>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </Collection>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 </Collections>
sogo-mailcow-1 | Jan 26 05:13:14 e7d0c4231f83 syslog-ng[8]: Error processing log message: </Sync>
sogo-mailcow-1 |
sogo-mailcow-1 | Go/Microsoft-Server-ActiveSync?User=<My Email>&DeviceId=<device id>&DeviceType=iPad&Cmd=Sync HTTP/1.0" 200 99/116 0.109 - - 24K - 12
sogo-mailcow-1 | - 12
sogo-mailcow-1 | -01-26T13:02:54.000Z</DateReceived>
sogo-mailcow-1 | <Importance xmlns="Email:">1</Importance>
sogo-mailcow-1 | <Read xmlns="Email:">0</Read>
sogo-mailcow-1 | <MessageClass xmlns="Email:">IPM.Note</MessageClass>
sogo-mailcow-1 | <ContentClass xmlns="Email:">urn:content-classes:message</ContentClass>
sogo-mailcow-1 | <Reply-To xmlns="Email:"><Sender Name> <<Sender Email>></Reply-To>
sogo-mailcow-1 | <InternetCPID xmlns="Email:">65001</InternetCPID>
sogo-mailcow-1 | <Body xmlns="AirSyncBase:">
sogo-mailcow-1 | <Type>1</Type>
sogo-mailcow-1 | <Truncated>0</Truncated>
sogo-mailcow-1 | <Preview/>
sogo-mailcow-1 | <Data>------------- REDACTED EMAIL CONTENT -------------------
Interestingly, when I restart Nginx or sogo container it stops occurring for now. I am, however, running mailcow behind nginx with the configuration mentioned here. https://docs.mailcow.email/post_installation/reverse-proxy/r_p-nginx/
Does this have any leads?
@Brend4n this looks like one broken message to me. did you try to delete this specific message? No idea though what is happening there.
@Brend4n this looks like one broken message to me. did you try to delete this specific message? No idea though what is happening there.
Well, I mean the error for the specific message disappears until the bug appears again with another message. That being said, it's clearly an issue somewhere if specific messages can somehow cause things to break.
Yes, there is something wrong for sure, maybe more than one thing. But I think so far nobody did a writeup of the issues here and reported them to sogo.
Well we did but no further response so far. @andi0b
Interestingly, when I restart Nginx or sogo container it stops occurring for now. I am, however, running mailcow behind nginx with the configuration mentioned here. https://docs.mailcow.email/post_installation/reverse-proxy/r_p-nginx/
Does this have any leads?
Interesting, the last few times it has happened, restarting nginx didn't fix it however stopping nginx for a few seconds and then starting it again will "fix" it temporarily. I believe stopping nginx somehow causes it to terminate whatever loop it's stuck in.
Interestingly, when I restart Nginx or sogo container it stops occurring for now. I am, however, running mailcow behind nginx with the configuration mentioned here. https://docs.mailcow.email/post_installation/reverse-proxy/r_p-nginx/ Does this have any leads?
Interesting, the last few times it has happened, restarting nginx didn't fix it however stopping nginx for a few seconds and then starting it again will "fix" it temporarily. I believe stopping nginx somehow causes it to terminate whatever loop it's stuck in.
It will occur after some time again, I noticed that behavior too sadly that is not a fix.
Reporting the same issue on my installation. Running 2024-01e. Active Sync client seems to enter some kind of a loop and spams Sogo continously.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
If someone wants to participate in our little conversation I would appreciate.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Nothing is staled, problem still persists.
Nothing is staled, problem still persists.
This is a SOGo problem, not mailcow. Please keep discussing at the SOGo issue you mentioned.
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs.
Not stale. This is still an issue for us. Does anyone know how to contribute to the discussion on the SOGo ticket?
Contribution guidelines
I've found a bug and checked that ...
Description
Logs:
Steps to reproduce:
Which branch are you using?
master
Operating System:
Ubuntu 22.04.1 LTS
Server/VM specifications:
RAM: 16GB, 8 Core
Is Apparmor, SELinux or similar active?
yes: Apparmor
Virtualization technology:
KVM
Docker version:
20.10.22
docker-compose version or docker compose version:
v2.6.0
mailcow version:
2023-02
Reverse proxy:
no
Logs of git diff:
Logs of iptables -L -vn:
Logs of ip6tables -L -vn:
Logs of iptables -L -vn -t nat:
Logs of ip6tables -L -vn -t nat:
DNS check: