matrix-org / libera-chat

Support requests for the libera.chat IRC bridge hosted by matrix.org
7 stars 2 forks source link

Channels with 100% IRC message loss #5

Open airone506 opened 1 year ago

airone506 commented 1 year ago

Hello users of the bridge. Please report here the IRC channels where the 100% message loss occurs.


#python at Libera.Chat. 100% of IRC messages lost since ~ June 4th, 03:26 UTC until now. Only join/leave messages are being bridged to Matrix.

Half-Shot commented 1 year ago

We're hoping to see some improvements with matrix-org/matrix-appservice-irc#1737 which hopefully will reduce message loss. Thanks for the reports though, we can take a look at individual cases.

Half-Shot commented 1 year ago

We've investigated #python and we're reasonably convinced that the bridge is working, but less convinced that the Matrix federation element is working. We're currently working things out.

Half-Shot commented 1 year ago

We logged https://github.com/matrix-org/synapse/issues/15730. After waiting a while, the room started working as normal and we're not seeing message drops. @airone506 what do you see in the room?

airone506 commented 1 year ago

The channel started to work around 16:12:41 UTC (today, June 6th). Message drop in #python is now only as described in https://github.com/matrix-org/libera-chat/issues/6, but not the 100%.

airone506 commented 1 year ago

@Half-Shot: To list another example, now it is the #libera channel that has gone completely silent (except join/leave messages). The "silence" started at the time frame between 18:29 and 18:51 UTC (today, June 6th) and it still continues (at the time of posting this comment).

Half-Shot commented 1 year ago

Investigated and it seemed to be caused by the a joining rooms (although being banned by the IRC network) and failing to get kicked, which activated the privacy protection mode which prohibits I->M traffic. This user has now been banned on the bridge to hopefully improve the situation.

Half-Shot commented 1 year ago

We're continuing to monitor the situation but it looks presently improved, please keep information coming as you have it.

podiki commented 1 year ago

Since sometime yesterday (about 22 hours for me) the bridge with #guix stopped working. As of now no matrix messages going through to IRC or vice versa, matrix users see each other's messages still it seems.

The sporadic failing of messages and larger downtime seems to have increased in the past 6 months or so, compared to the previous year.

airone506 commented 1 year ago

It is also #python, 100% loss of bridged messages ongoing for several hours now.

podiki commented 1 year ago

Just found out about https://libera.chat/news/matrix-deportalling and https://matrix.org/blog/2023/07/deportalling-libera-chat/ so I guess that is the bigger event (and I wasn't wrong thinking the bridge has been getting worse)