Ejabberd: upgrade to 18.06

[stephdl]

As per the title, upgrade to the version 18.6

• [x] Rewrite the ejabberd.cfg to ejabberd.yml
• [x] create multiple fragments of ejabberd.yml (one piece to ease development)
• [x] Delete the old configuration
• [x] Enable mod_mam (message archive)
• [x] Keep mod_offline for backward compatibility (old message archive module)
• [x] Keep Mnesia for database
• [x] Test and check if it is needed to remove old messages for mod_mam (table < 2GB)
• [x] An issue with group or user name appears following ldap or samba AD, the name is not the good one, but the chat is functionnal
• [x] Create UI online documentation
• [x] Web UI in nethgui

See also

https://community.nethserver.org/t/ejabberd-16-01-bug-or-issue/10123

---

thank gerald_FS for your obstinacy and thank to @gsanchietti for the first work

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.2.g73481a3.ns7.noarch.rpm

[stephdl]

QA

• Install nethserver-ejabberd from stable repository (16.01)
• Tests should be done with openldap and samba AD
• Create permanent chat rooms
• Upgrade nethserver-ejabberd -> 18.06
• Permanent chat rooms must exist
• List of users is available (set to see also unavailable users in your ejabberd client)
• A minimal panel exists now with few settings

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.2.g73481a3.ns7.noarch.rpm

[gsanchietti]

I've found some errors:

• with AD all users are grouped under "Administrator" group -WelcomeText prop is not deleted
• shaperNormal and shaperFast properties doesn't respect CamelCase conventions

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.2.g73481a3.ns7.noarch.rpm

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.7.g7c65ce6.ns7.noarch.rpm

[gsanchietti]

Back on testing, no info about how to test S2S.

[gsanchietti]

S2S test case

• create 2 server with different domains
• make sure port 5269 of each server is open
• configure SRV DNS records (https://wiki.xmpp.org/web/SRV_Records#XMPP_SRV_records)
• login to both servers with 2 different clients
• from one client, add a user of the remote server
• try to send a message to the remote user

[gsanchietti]

Verification failed.

Current S2S configuration is not working, error from /var/log/ejabberd/ejabberd.log:

2018-07-13 11:03:29.973 [info] <0.513.0>@ejabberd_s2s_out:process_closed:160 Failed to establish outbound s2s connection nethesis.it -> nethserver.net: Connection failed: connection closed; bouncing for 57 seconds

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.8.gb556111.ns7.noarch.rpm

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.8.ge7285a5.ns7.noarch.rpm

[gsanchietti]

Again back on QA, please test S2S configuration.

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.8.ge7285a5.ns7.noarch.rpm

[DavidePrincipi]

The build on TravisCI.com now is fixed.

https://travis-ci.com/NethServer/nethserver-ejabberd/builds/78919469

I don't know why it started to build on TravisCI.org...

[TonyBostonTB]

are there any insights needed for s2s, still?

[gsanchietti]

The only thing needed is the correct DNS configuration, see above comment (https://github.com/NethServer/dev/issues/5537#issuecomment-404776376).

S2S has been verified by gerald_FS.

But there are still a couple of open issues about mod_mam:

• [x] mod_mam mnesia database is not included inside the backup data
• [x] document mnesia database cleanup
• [x] disable mod_mam by default and add a new property to enable it (see privacy note below)

Privacy note

When mod_mam is enabled, the server will store all messages. In many scenarios, this behavior can raise privacy concerns. Since the event of GDPR, is better to avoid retaining such sensitive data unless the administrator want to explicitly enable the feature.

[stephdl]

@gsanchietti mod_mam warns in log when it is disabled, mod_muc needs it, I search if it is a problem or just some sounds

2018-08-17 16:04:47.976 [warning] <0.319.0>@gen_mod:sort_modules:155 Module 'mod_mam' is recommended for module 'mod_muc' but is not found in the config

[stephdl]

• [x] Make documentation

I can find this warning in logs, this should be done at a documentation level, the certificate must match the domain used for ejabberd and also the subdomains pubsub.* conference.*

2018-08-17 16:04:47.913 [warning] <0.340.0>@ejabberd_pkix:handle_call:259 No certificate found matching 'nethservertest.org': strictly configured clients or servers will reject connections with this host; obtain
 a certificate for this (sub)domain from any trusted CA such as Let's Encrypt (www.letsencrypt.org)

2018-08-17 16:04:47.996 [warning] <0.340.0>@ejabberd_pkix:handle_call:259 No certificate found matching 'conference.nethservertest.org': strictly configured clients or servers will reject connections with this h
ost; obtain a certificate for this (sub)domain from any trusted CA such as Let's Encrypt (www.letsencrypt.org)

2018-08-17 16:04:48.065 [warning] <0.340.0>@ejabberd_pkix:handle_call:259 No certificate found matching 'pubsub.nethservertest.org': strictly configured clients or servers will reject connections with this host;
 obtain a certificate for this (sub)domain from any trusted CA such as Let's Encrypt (www.letsencrypt.org)```

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.9.gf072e08.ns7.noarch.rpm

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.10.g42ef860.ns7.noarch.rpm

[stephdl]

QA what you must check:

• mod_mam can be disabled in the server-manager, check that the module is no more enabled
• you can purge the old messages in mod_mam by a check box (a cron job start each night, you can trigger it by : /etc/cron.daily/ejabberd-purge-mod_mam-database)
• you can backup the mnesia database with backup-data, (do a backup and restore the server), the backup folder is at /var/lib/nethserver/ejabberd

[stephdl]

• [x] think to push translations

[gsanchietti]

Verified.

Before release, please update developer and administrator manual.

[nethbot]

in 7.5.1804/testing:

• nethserver-ejabberd-1.1.5-1.11.g4c15918.ns7.noarch.rpm

[stephdl]

translation pushed @gsanchietti

[nethbot]

in 7.5.1804/updates:

• ejabberd-18.06-0.x86_64.rpm
• nethserver-ejabberd-1.2.0-1.ns7.noarch.rpm