containers memory usage

[j2l]

The 3 more demanding containers on my home VPS are onlyoffice:

I'm not sure I need Elastic Search. When I shut down Elastic Search container, I got many other onlyoffice containers eating the memory:

In my docker-compose.yml, I added

 - NGINX_WORKER_PROCESSES=1
     - NGINX_WORKER_CONNECTIONS=20

on documents and community containers but it looks like everything is trying to eat all the memory none the less.

Any idea how to limit though voracious beasts? :smile:

[Carazyda]

Hello @j2l elasticsearch is responsible for full-text search. If you don't need it, you can turn it off. For our application, the minimum requirements are 6GB of ram and a swap file, if you limit memory consumption, we cannot guarantee the stable operation of all services.

[j2l]

Thanks @Carazyda It eats far beyond 6GB, and I have 8GB. I've seen other feedback here that shows less consumption. What can be done? Thanks

[Carazyda]

How many active users do you currently have on the portal? Or is it consumption immediately after installation? What is your host OS?

[j2l]

One user, no email configured, no added documents, no content, nothing, just for testing. After cloning release/v12.0, I simply did docker-compose up without modifying it before. Host is Ubuntu Linux 20.04.4

Even after completely removing the elastic search container, I see multiple processes that, AFAIK, didn't exist when elastic search was present. one process is related to it. Consumption is right after clean install + removing elastisearch.

Each of them is consuming a lot (screenshot taken 1h before processes):

Looks like each write log like crazy :smile:

When I stop the community container, all processes are removed, but of course, I can't access document and mail anymore.

Here's the list of processe right now:

dnsmasq  1985625  0.0  0.1 581388 12424 ?        Sl   Apr13   0:01 /var/www/onlyoffice/documentserver/server/Metrics/metrics ./config/config.js
dnsmasq  1986242  0.0  0.7 910456 60400 ?        Sl   Apr13   0:13 /var/www/onlyoffice/documentserver/server/DocService/docservice
dnsmasq  1986255  0.0  0.3 594096 30976 ?        Sl   Apr13   0:05 /var/www/onlyoffice/documentserver/server/FileConverter/converter
dnsmasq  1986261  0.0  0.6 712348 54744 ?        Sl   Apr13   0:04 /var/www/onlyoffice/documentserver/server/FileConverter/converter /snapshot/server/build/server/FileConverter/sources/convertermaster.js
root     1991521  0.0  0.0   5476    64 ?        S+   Apr13   0:00 tail -f /var/log/onlyoffice/documentserver/converter/err.log /var/log/onlyoffice/documentserver/converter/out.log /var/log/onlyoffice/documentserver/docservice/err.log /var/log/onlyoffice/documentserver/docservice/out.log /var/log/onlyoffice/documentserver/metrics/err.log /var/log/onlyoffice/documentserver/metrics/out.log /var/log/onlyoffice/documentserver/nginx.error.log /var/log/onlyoffice/documentserver/spellchecker/err.log /var/log/onlyoffice/documentserver/spellchecker/out.log
syslog   2427224  0.0  0.6 600924 51128 ?        Sl   09:50   0:01 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeUrlShortener /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.UrlShortener.Svc.Launcher,ASC.UrlShortener.Svc" --log UrlShortener
syslog   2427225  0.0  0.6 668540 51216 ?        Sl   09:50   0:01 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeThumb /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.Thumbnails.Svc.Launcher,ASC.Thumbnails.Svc" --log Thumb
syslog   2427226  0.2  1.1 2281828 96560 ?       Sl   09:50   0:40 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeTelegram /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.TelegramService.Launcher,ASC.TelegramService" --log Telegram
syslog   2427228  0.0  0.6 871320 51168 ?        Sl   09:50   0:01 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeSsoAuth /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.SsoAuth.Svc.Launcher,ASC.SsoAuth.Svc" --log SsoAuth
syslog   2427230  0.2  1.3 2279568 110916 ?      Sl   09:50   0:41 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/Jabber -l:/tmp/onlyofficeJabber /var/www/onlyoffice/Services/Jabber/ASC.Xmpp.Server.Launcher.exe --service "ASC.Xmpp.Host.XmppServerLauncher,ASC.Xmpp.Host" --log Jabber
syslog   2427272  0.0  0.8 1566500 72500 ?       Sl   09:50   0:14 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeStorageMigrate /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.Data.Storage.Migration.Launcher,ASC.Data.Storage.Migration --log StorageMigrate
syslog   2427274  0.2  1.6 2337348 136980 ?      Sl   09:50   0:51 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeNotify /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.Notify.NotifyServiceLauncher,ASC.Notify --log Notify
syslog   2427284  0.1  0.8 2249960 72004 ?       Sl   09:50   0:31 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeSocketIO /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.Socket.IO.Svc.Launcher,ASC.Socket.IO.Svc" --log SocketIO
syslog   2427286  0.2  1.5 2309628 124252 ?      Sl   09:50   0:55 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeIndex /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.ElasticSearch.Launcher,ASC.ElasticSearch --log Index
syslog   2427289  0.0  1.0 1306164 82468 ?       Sl   09:50   0:17 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/MailWatchdog -l:/tmp/onlyofficeMailWatchdog /var/www/onlyoffice/Services/MailWatchdog/ASC.Mail.Watchdog.Service.exe
syslog   2427292  0.3  1.2 2272312 101052 ?      Sl   09:50   1:09 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeThumbnailBuilder /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.Files.ThumbnailBuilder.Launcher,ASC.Files.ThumbnailBuilder --log ThumbnailBuilder
syslog   2427293  0.0  0.8 1566460 72756 ?       Sl   09:50   0:14 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeStorageEncryption /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.Data.Storage.Encryption.Launcher,ASC.Data.Storage.Encryption --log StorageEncryption
syslog   2427295  0.0  0.8 1228020 71200 ?       Sl   09:50   0:08 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/MailCleaner -l:/tmp/MailCleaner /var/www/onlyoffice/Services/MailCleaner/ASC.Mail.StorageCleaner.exe
syslog   2427297  0.1  1.0 2116784 85056 ?       Sl   09:50   0:19 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeBackup /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service ASC.Data.Backup.Service.BackupServiceLauncher,ASC.Data.Backup --log Backup
syslog   2427302  0.2  1.4 2302092 119520 ?      Sl   09:50   0:46 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeFeed /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.Feed.Aggregator.FeedAggregatorLauncher,ASC.Feed.Aggregator" --log Feed
syslog   2427306  0.0  0.6 601228 51408 ?        Sl   09:50   0:01 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/TeamLabSvc -l:/tmp/onlyofficeRadicale /var/www/onlyoffice/Services/TeamLabSvc/TeamLabSvc.exe --service "ASC.Radicale.Launcher,ASC.Radicale" --log Radicale
syslog   2427513  0.9 16.9 3533444 1379484 ?     Ssl  09:50   2:51 /usr/bin/mono /usr/lib/hyperfastcgi/4.0/HyperFastCgi.exe /config=/etc/hyperfastcgi/onlyoffice /logfile=/var/log/onlyoffice/onlyoffice.log /loglevels=Error
syslog   2427518  0.0  0.5 397812 44864 ?        Ssl  09:50   0:02 /usr/bin/mono /usr/lib/hyperfastcgi/4.0/HyperFastCgi.exe /config=/etc/hyperfastcgi/onlyofficeApiSystem /logfile=/var/log/onlyoffice/onlyofficeApiSystem.log /loglevels=Error
syslog   2427519  0.1  1.0 1383980 87796 ?       Sl   09:50   0:33 /usr/bin/mono /usr/lib/mono/4.5/mono-service.exe -d:/var/www/onlyoffice/Services/MailAggregator -l:/tmp/onlyofficeMailAggregator /var/www/onlyoffice/Services/MailAggregator/ASC.Mail.Aggregator.CollectionService.exe
syslog   2427613  0.0  0.5 1668332 44644 ?       Sl   09:50   0:01 /usr/bin/node /var/www/onlyoffice/Services/ASC.UrlShortener/index.js
syslog   2427616  0.0  0.5 619080 41836 ?        Sl   09:50   0:01 /usr/bin/node /var/www/onlyoffice/Services/ASC.Thumbnails/index.js
syslog   2427625  0.0  1.0 676576 84248 ?        Sl   09:50   0:02 /usr/bin/node /var/www/onlyoffice/Services/ASC.SsoAuth/app.js
syslog   2427626  0.0  0.3  78820 29728 ?        S    09:50   0:00 /usr/bin/python3 -m radicale --config /var/www/onlyoffice/Services/TeamLabSvc/radicale.config
syslog   2427777  0.0  0.7 912120 59320 ?        Sl   09:50   0:06 /usr/bin/node /var/www/onlyoffice/Services/ASC.Socket.IO/app.js

[Carazyda]

Sorry, but v12.0 is on testing now. Release version is 11.6. Please try with it.

[j2l]

Sorry, forgot to say, the release install didn't work at all for me. I tried following the readme (manual install of each container), docker-compose, and the .sh script. I crawled many errors leading to issues here without being able to fix it.

[Carazyda]

Can you point out what specific problems you are facing with installing version 11.6?

[j2l]

I spent hours and got frustrated to the point of simply giving up, when I noticed the latest branch and gave it a try (a last one before moving on) and it worked. I didn't log errors as it was the start and I wanted to forget the frustration :smile:

Looking at my history, here are my search and results (issues): https://github.com/ONLYOFFICE/Docker-CommunityServer/search?q=onlyoffice_user&type=issues https://github.com/ONLYOFFICE/Docker-CommunityServer/search?q=%22my-secret-pw%22&type=issues (mysql container refused any connection because tables were not populated despite each containers having root password) https://github.com/ONLYOFFICE/Docker-CommunityServer/search?q=aborted+connection&type=issues (same as above) https://github.com/ONLYOFFICE/Docker-CommunityServer/search?q=elasticsearch&type=issues https://github.com/ONLYOFFICE/Docker-CommunityServer/search?q=rabbitmq&type=issues

https://github.com/ONLYOFFICE/Docker-DocumentServer/issues/69 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/55 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/113 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/147 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/92 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/116 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/125 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/128 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/81 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/75 https://github.com/ONLYOFFICE/Docker-CommunityServer/issues/88 https://github.com/ONLYOFFICE/DocumentServer/issues/91

[Carazyda]

Most of these issues are old and closed. Please describe your problems again in new issues. Or wait for the 12.0 release, which is coming soon.

[wlfcss]

the same issue in version 11.6, just two user, 2GB file

[Carazyda]

Hello @wlfcss most of used memory is reserved for the elasticsearch for indexing full-text search in documents and mail. What exactly is your problem? Memory runs out and application crashes?