YunoHost-Apps / synapse_ynh

Matrix server (synapse) package for YunoHost
https://matrix.org/
GNU General Public License v3.0
79 stars 43 forks source link

Can't upgrade synapse (and the upgrade kills fail2ban) #380

Closed noccio closed 1 year ago

noccio commented 1 year ago

Yunohost stable on a raspberry pi4 running 32 bit version of OS.

If I try to upgrade synapse I get this error:

Warning: ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.

Warning: setuptools-rust 1.5.2 requires setuptools>=62.4, but you have setuptools 60.8.2 which is incompatible.

and a long series of errors (this is the log https://paste.yunohost.org/uxocagurux

And after the failed upgrade fail2ban gives an error (this is the log https://paste.yunohost.org/wuzidociba) and I need to restart manually fail2ban.

P.S.: this problem also in https://forum.yunohost.org/t/cant-upgrade-synapse-and-the-upgrade-kills-fail2ban/24759

lapineige commented 1 year ago

From 1.81 to 1.84, same warning, but the upgrade is completed… :thinking:

Yet the service keeps restarting, and the server is not working.

lapineige commented 1 year ago

I installed that setuptools version.

Then in the service log :

Error in configuration at 'a.p.p._.s.e.r.v.i.c.e._.c.o.n.f.i.g._.f.i.l.e.s':
python[285426]:   Expected 'None' to be a list of AS config files:
lapineige commented 1 year ago

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. :thinking:

Thatoo commented 1 year ago

@lapineige could you share with details (command lines) what you did after (maybe before too) the upgrade please?

noccio commented 1 year ago

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. thinking

pip shows me setuptools version 52.0.0

pip show setuptools
Name: setuptools
Version: 52.0.0
Summary: Easily download, build, install, upgrade, and uninstall Python packages
Home-page: https://github.com/pypa/setuptools
Author: Python Packaging Authority
Author-email: distutils-sig@python.org
License: UNKNOWN
Location: /usr/lib/python3/dist-packages
Requires: 
Required-by: 
Schoebi commented 1 year ago

I have a similar issue: https://forum.yunohost.org/t/upgrade-synapse-problem/24890

lapineige commented 1 year ago

@noccio yes I had the same version.

I didn't keep track of the whole set of actions, but if I remember correctly I went to /opt/yunohost/matrix-synapse, activated the venv, then installed a more recent setuptool version. Roughly the commands are:

cd /opt/yunohost/matrix-synapse/bin
source activate # activate the virtual environment
python -m pip install  setuptools==67.8.0

And reload the service.

Thatoo commented 1 year ago

I went in the virtual environnement, installed the minimal setuptool version required (62.4.0), v67.8.0 was already here, so I switched back to it… and in the midtime, Synapse was working again. thinking

I did exactly the same but synapse keeps restarting...

● matrix-synapse.service - Synapse Matrix homeserver
     Loaded: loaded (/etc/systemd/system/matrix-synapse.service; enabled; vendor preset: enabled)
     Active: activating (start-pre) since Fri 2023-05-26 22:19:02 BST; 2s ago
Cntrl PID: 2833 (python)
      Tasks: 1 (limit: 3933)
        CPU: 1.243s
     CGroup: /system.slice/matrix-synapse.service
             └─2833 /opt/yunohost/matrix-synapse/bin/python -m synapse.app.homeserver --config-path=/etc/matrix-synapse/homeserver.yaml --config-path=/etc/matrix-synapse/conf.d/ --generate-keys

May 26 22:19:02 ger.fr systemd[1]: Starting Synapse Matrix homeserver...

too bad. I'll try to restore.

Thatoo commented 1 year ago

restoration worked ouf

Thatoo commented 1 year ago

forgot to mention that my raspi4 is 64 bit not 32.

dbflexi commented 1 year ago

@Thatoo I have the same problem. First tried to rollback with yunohost backup to "synapse-pre-upgrade1" but this does not work. (The following apps cannot be restored because they are already installed: synapse). Then I tried @lapineige variant. Unfortunately, this had the same effect: Synapse always restarted anyway. How did you restore Synapse @Thatoo?

JimboJoe commented 1 year ago

A fix that worked for me:

vi /etc/matrix-synapse/conf.d/app_service.yaml

Change the line to (add brackets):

app_service_config_files: []

Seems linked to a bad factory configuration in the package (need someone to do the PR), and a stricter control of configuration file in upstream version (upstream PR https://github.com/matrix-org/synapse/pull/15425)

dbflexi commented 1 year ago

@JimboJoe that worked for me too :-)

Thatoo commented 1 year ago

@Thatoo I have the same problem. First tried to rollback with yunohost backup to "synapse-pre-upgrade1" but this does not work. (The following apps cannot be restored because they are already installed: synapse). Then I tried @lapineige variant. Unfortunately, this had the same effect: Synapse always restarted anyway. How did you restore Synapse @Thatoo?

I had to delete synapse app first and then restore but you find a way already then.

Josue-T commented 1 year ago

Should be fixed by b1968a55cb1ab413e5c4a7e2b1082760a7fae6d9

noccio commented 1 year ago

I still cannot upgrade. I have a long series of lines of errors but I think these are the relevant:

Warning: 201342 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
Warning: 201343 setuptools-rust 1.5.2 requires setuptools>=62.4, but you have setuptools 60.8.2 which is incompatible.
Warning: The app was restored to the way it was before the failed upgrade.

And I don't how to upgrade pip or setuptools or whatever and also if this is good for my installation (ynh stable on raspi4 32 bit)

Josue-T commented 1 year ago

I still cannot upgrade. I have a long series of lines of errors but I think these are the relevant:

Warning: 201342 ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
Warning: 201343 setuptools-rust 1.5.2 requires setuptools>=62.4, but you have setuptools 60.8.2 which is incompatible.
Warning: The app was restored to the way it was before the failed upgrade.

And I don't how to upgrade pip or setuptools or whatever and also if this is good for my installation (ynh stable on raspi4 32 bit)

OK so firstly please create a new issue because it's a different problem and provide the full log.

hanswundersam commented 1 year ago

A fix that worked for me:

vi /etc/matrix-synapse/conf.d/app_service.yaml

Change the line to (add brackets):

app_service_config_files: []

Seems linked to a bad factory configuration in the package (need someone to do the PR), and a stricter control of configuration file in upstream version (upstream PR matrix-org/synapse#15425)

This saved my life, thank you for posting it here @JimboJoe !