search

element-hq / synapse

Synapse: Matrix homeserver written in Python/Twisted.
https://element-hq.github.io/synapse
GNU Affero General Public License v3.0
1.56k stars 191 forks source link

"Error: no create event in state" when joining room #17377

Open tusooa opened 4 months ago

tusooa commented 4 months ago

Description

Joining a room will result in "No create event in state" error.

Steps to reproduce

Homeserver

tusooa.xyz

Synapse Version

v1.109.0

Installation Method

Docker (matrixdotorg/synapse)

Database

postgresql; single server; used portdb; restored from backup

Workers

Multiple workers

Platform

Docker swarm across 4 nodes; Ubuntu 22.04

Configuration

No presence

Relevant log output

see the first comment below

Anything else that would be useful to know?

#webrtc:matrix.org works, even though it's also my first time joining the room. I am wondering whether this is due to the special characters present in the room alias (. in matrix.to and capital letters in FrOSCon).

tusooa commented 4 months ago

log.txt

devonh commented 4 months ago

It seems like joining #matrix.to:matrix.org from a new homeserver will no longer work since the original server used to create the room (riot.ovh) is no longer operational. This means your server won't be able to obtain the server's signing keys to verify the room creation event, as well as other important state events.

You can join that room from an account on matrix.org (or any other server that already has an account which is a member of the room) since those homeservers will have already been able to obtain the signing keys necessary to verify the room's events. Any new homeserver will not be able to fetch the appropriate signing keys, and therefore will not be able to join the room properly.

devonh commented 4 months ago

Do you have any logs for #FrOSCon:fiksel.info? (I didn't see it in the logs you sent, so I don't know if that room is the same issue or not)

tusooa commented 4 months ago 
2024-07-04 00:11:49,629 - synapse.http.matrixfederationclient - 362 - INFO - POST-220059 - {GET-O-7415720} [fiksel.info] Completed request: 200 OK in 0.60 secs, got 255 bytes - GET matrix-federation://fiksel.info/_matrix/federation/v1/query/directory?room_alias=%23FrOSCon%3Afiksel.info
2024-07-04 00:11:49,815 - synapse.http.matrixfederationclient - 362 - INFO - POST-220059 - {GET-O-7415721} [fiksel.info] Completed request: 200 OK in 0.16 secs, got 540 bytes - GET matrix-federation://fiksel.info/_matrix/federation/v1/make_join/%21TKwWruZKKeLKsejkzE%3Afroscon2019.fiksel.info/%40tusooa%3Atusooa.xyz?ver=1&ver=2&ver=3&ver=4&ver=5&ver=6&ver=7&ver=8&ver=9&ver=10&ver=11
2024-07-04 00:11:50,454 - synapse.http.matrixfederationclient - 362 - INFO - POST-220059 - {PUT-O-7415722} [fiksel.info] Completed request: 200 OK in 0.63 secs, got 49895 bytes - PUT matrix-federation://fiksel.info/_matrix/federation/v2/send_join/%21TKwWruZKKeLKsejkzE%3Afroscon2019.fiksel.info/%24hymE7HvEEhvR2HTj6zKIx_7pw_yyTZZt0w6GpSGct-o?omit_members=true
2024-07-04 00:11:50,459 - synapse.federation.federation_client - 1120 - INFO - POST-220059 - Processing from send_join 49 events
2024-07-04 00:11:50,485 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2347 - Fetching https://im.kabi.tk/.well-known/matrix/server
2024-07-04 00:11:50,488 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2348 - Fetching https://froscon2020.fiksel.info/.well-known/matrix/server
2024-07-04 00:11:50,490 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2346 - Fetching https://luki.org/.well-known/matrix/server
2024-07-04 00:11:50,492 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2343 - Fetching https://matrix.d0pe.eu/.well-known/matrix/server
2024-07-04 00:11:50,494 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2345 - Fetching https://bau-ha.us/.well-known/matrix/server
2024-07-04 00:11:50,496 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2344 - Fetching https://breadpirates.chat/.well-known/matrix/server
2024-07-04 00:11:50,498 - synapse.http.federation.well_known_resolver - 260 - INFO - ServerKeyFetcher-2342 - Fetching https://froscon2019.fiksel.info/.well-known/matrix/server
2024-07-04 00:11:50,511 - synapse.http.federation.well_known_resolver - 197 - INFO - ServerKeyFetcher-2347 - Response from .well-known: {'m.server': 'im.kabi.tk:443'}
2024-07-04 00:11:50,521 - synapse.http.matrixfederationclient - 362 - INFO - ServerKeyFetcher-2347 - {GET-O-7415730} [im.kabi.tk] Completed request: 200 OK in 0.04 secs, got 303 bytes - GET matrix-federation://im.kabi.tk/_matrix/key/v2/server
2024-07-04 00:11:50,535 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54495 - Streaming: caches -> 24851837 (limited: False, updates: 2, max token: 24851836)
2024-07-04 00:11:50,539 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54495 - Streaming: caches -> 24851837 (limited: False, updates: 1, max token: 24851837)
2024-07-04 00:11:50,553 - synapse.http.federation.well_known_resolver - 291 - INFO - ServerKeyFetcher-2348 - Error fetching https://froscon2020.fiksel.info/.well-known/matrix/server: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,561 - synapse.http.matrixfederationclient - 362 - INFO - ServerKeyFetcher-2341 - {GET-O-7415724} [matrix.org] Completed request: 200 OK in 0.08 secs, got 398 bytes - GET matrix-federation://matrix.org/_matrix/key/v2/server
2024-07-04 00:11:50,564 - synapse.http.federation.well_known_resolver - 291 - INFO - ServerKeyFetcher-2342 - Error fetching https://froscon2019.fiksel.info/.well-known/matrix/server: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,575 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54496 - Streaming: caches -> 24851841 (limited: False, updates: 4, max token: 24851839)
2024-07-04 00:11:50,578 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54496 - Streaming: caches -> 24851841 (limited: False, updates: 2, max token: 24851841)
2024-07-04 00:11:50,626 - synapse.http.federation.well_known_resolver - 197 - INFO - ServerKeyFetcher-2345 - Response from .well-known: {'m.server': 'bau-ha.us:8448'}
2024-07-04 00:11:50,659 - synapse.http.federation.well_known_resolver - 197 - INFO - ServerKeyFetcher-2344 - Response from .well-known: {'m.server': 'breadpirates.chat:443'}
2024-07-04 00:11:50,662 - synapse.http.federation.well_known_resolver - 197 - INFO - ServerKeyFetcher-2346 - Response from .well-known: {'m.server': 'matrix.luki.org:8448'}
2024-07-04 00:11:50,692 - synapse.http.matrixfederationclient - 362 - INFO - ServerKeyFetcher-2340 - {GET-O-7415723} [fiksel.info] Completed request: 200 OK in 0.22 secs, got 305 bytes - GET matrix-federation://fiksel.info/_matrix/key/v2/server
2024-07-04 00:11:50,708 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54497 - Streaming: caches -> 24851843 (limited: False, updates: 2, max token: 24851842)
2024-07-04 00:11:50,711 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54497 - Streaming: caches -> 24851843 (limited: False, updates: 1, max token: 24851843)
2024-07-04 00:11:50,715 - synapse.http.federation.matrix_federation_agent - 371 - INFO - ServerKeyFetcher-2348 - Failed to connect to froscon2020.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,717 - synapse.http.matrixfederationclient - 799 - INFO - ServerKeyFetcher-2348 - {GET-O-7415731} [froscon2020.fiksel.info] Request failed: GET matrix-federation://froscon2020.fiksel.info/_matrix/key/v2/server: DNSLookupError('no results for hostname lookup: froscon2020.fiksel.info')
2024-07-04 00:11:50,718 - synapse.crypto.keyring - 852 - WARNING - ServerKeyFetcher-2348 - Error looking up keys from froscon2020.fiksel.info: Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,720 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $i6Ht7jZtdNgAafeeG3PqHiqMGs4-xV0uy5Wr9y9BImM was invalid (unable to verify signature for sender domain froscon2020.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2020.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_dwDc'])). Checking local store/origin server
2024-07-04 00:11:50,722 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $eSbeiDWLditNMpJq219XUHLqiKF_Dyfs0MpTltdvi8Q was invalid (unable to verify signature for sender domain froscon2020.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2020.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_dwDc'])). Checking local store/origin server
2024-07-04 00:11:50,726 - synapse.http.federation.matrix_federation_agent - 371 - INFO - ServerKeyFetcher-2346 - Failed to connect to matrix.luki.org:8448: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,727 - synapse.http.matrixfederationclient - 799 - INFO - ServerKeyFetcher-2346 - {GET-O-7415729} [luki.org] Request failed: GET matrix-federation://luki.org/_matrix/key/v2/server: DNSLookupError('no results for hostname lookup: matrix.luki.org')
2024-07-04 00:11:50,728 - synapse.crypto.keyring - 852 - WARNING - ServerKeyFetcher-2346 - Error looking up keys from luki.org: Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,730 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $9ytNb7fXTp3R4mk2vb5TAO88FCZ4rpAa2itxlEAqBPI was invalid (unable to verify signature for sender domain luki.org: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='luki.org', minimum_valid_until_ts=0, key_ids=['ed25519:a_JYUl'])). Checking local store/origin server
2024-07-04 00:11:50,732 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $5ewnY4oHhLN6i_-MjwZFU1yWnRKhp05K1zm9XMj4fSQ was invalid (unable to verify signature for sender domain luki.org: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='luki.org', minimum_valid_until_ts=0, key_ids=['ed25519:a_JYUl'])). Checking local store/origin server
2024-07-04 00:11:50,736 - synapse.http.federation.matrix_federation_agent - 371 - INFO - ServerKeyFetcher-2342 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,738 - synapse.http.matrixfederationclient - 799 - INFO - ServerKeyFetcher-2342 - {GET-O-7415725} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/key/v2/server: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,739 - synapse.crypto.keyring - 852 - WARNING - ServerKeyFetcher-2342 - Error looking up keys from froscon2019.fiksel.info: Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,740 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $NUjspGmAgZ7bOvel--xPxtz6QOc2y8ZMTnXYygrZmz4 was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,742 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $mYmK1IzBrSl96elUgyY2eZ8EhegzXWyFKddProyr1_w was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,744 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $3aurFaWCAiUX63mjMQYW_GrojrhkdTQFCVNoZpdP4xM was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,745 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $LZx8gsdh5Oyu63T21qjPvF-Tl0DlTiaTjkLug1_O9bA was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,749 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $-NwxVV1Fqyd0MWrVk04VDdE9IXn3Pn8eRiUHkmnzyb8 was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,751 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $bIlM8d0p3bdXdOsZDJcf4QfmBYUqw68rwh1yj9ltOUo was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,753 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $sIF0MDB0RKwZcvEwYreTXjItCp2PEDlWeApEnZ3ASWQ was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,755 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $8qZ4zAlwAztm5TZ3CXoCOGYhAkXtOPEr0pAIYLMo9UI was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,756 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $K-o6eMEV9Z1cGi-cezmtIiGh9fOfHFRC-IL9cZm-tok was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,758 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $_TmMNMr5C2XU7K8td1ayyNg7nTT5CUEVh1nTouiaiJo was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,759 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $JV3LD2revd5Iw7WWdGjhhq1O5QVa7ry0asdae5xnNeY was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,761 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $GsXFjF27BdswIXLAoEUgmenaHgyo1_N91wO2T0eC3AE was invalid (unable to verify signature for sender domain froscon2019.fiksel.info: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='froscon2019.fiksel.info', minimum_valid_until_ts=0, key_ids=['ed25519:a_XRiF'])). Checking local store/origin server
2024-07-04 00:11:50,766 - synapse.http.matrixfederationclient - 362 - INFO - ServerKeyFetcher-2345 - {GET-O-7415728} [bau-ha.us] Completed request: 200 OK in 0.29 secs, got 301 bytes - GET matrix-federation://bau-ha.us/_matrix/key/v2/server
2024-07-04 00:11:50,784 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54498 - Streaming: caches -> 24851845 (limited: False, updates: 2, max token: 24851844)
2024-07-04 00:11:50,787 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54498 - Streaming: caches -> 24851845 (limited: False, updates: 1, max token: 24851845)
2024-07-04 00:11:50,812 - synapse.http.matrixfederationclient - 362 - INFO - ServerKeyFetcher-2344 - {GET-O-7415727} [breadpirates.chat] Completed request: 200 OK in 0.33 secs, got 317 bytes - GET matrix-federation://breadpirates.chat/_matrix/key/v2/server
2024-07-04 00:11:50,823 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54499 - Streaming: caches -> 24851847 (limited: False, updates: 2, max token: 24851846)
2024-07-04 00:11:50,827 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54499 - Streaming: caches -> 24851847 (limited: False, updates: 1, max token: 24851847)
2024-07-04 00:11:50,830 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to matrix.luki.org:8448: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,831 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415735} [luki.org] Request failed: GET matrix-federation://luki.org/_matrix/federation/v1/event/%245ewnY4oHhLN6i_-MjwZFU1yWnRKhp05K1zm9XMj4fSQ: DNSLookupError('no results for hostname lookup: matrix.luki.org')
2024-07-04 00:11:50,833 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to luki.org was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: matrix.luki.org.)); backoff now 2454670
2024-07-04 00:11:50,836 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$5ewnY4oHhLN6i_-MjwZFU1yWnRKhp05K1zm9XMj4fSQ): Failed to get PDU from luki.org because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,837 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $5ewnY4oHhLN6i_-MjwZFU1yWnRKhp05K1zm9XMj4fSQ with valid signature
2024-07-04 00:11:50,841 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to matrix.luki.org:8448: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,842 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415734} [luki.org] Request failed: GET matrix-federation://luki.org/_matrix/federation/v1/event/%249ytNb7fXTp3R4mk2vb5TAO88FCZ4rpAa2itxlEAqBPI: DNSLookupError('no results for hostname lookup: matrix.luki.org')
2024-07-04 00:11:50,843 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to luki.org was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: matrix.luki.org.)); backoff now 3378605
2024-07-04 00:11:50,845 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$9ytNb7fXTp3R4mk2vb5TAO88FCZ4rpAa2itxlEAqBPI): Failed to get PDU from luki.org because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: matrix.luki.org.
2024-07-04 00:11:50,846 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $9ytNb7fXTp3R4mk2vb5TAO88FCZ4rpAa2itxlEAqBPI with valid signature
2024-07-04 00:11:50,850 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54500 - Streaming: caches -> 24851848 (limited: False, updates: 1, max token: 24851848)
2024-07-04 00:11:50,854 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54501 - Streaming: caches -> 24851849 (limited: False, updates: 1, max token: 24851849)
2024-07-04 00:11:50,891 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2020.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,894 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415733} [froscon2020.fiksel.info] Request failed: GET matrix-federation://froscon2020.fiksel.info/_matrix/federation/v1/event/%24eSbeiDWLditNMpJq219XUHLqiKF_Dyfs0MpTltdvi8Q: DNSLookupError('no results for hostname lookup: froscon2020.fiksel.info')
2024-07-04 00:11:50,895 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2020.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.)); backoff now 2518205
2024-07-04 00:11:50,897 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$eSbeiDWLditNMpJq219XUHLqiKF_Dyfs0MpTltdvi8Q): Failed to get PDU from froscon2020.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,899 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $eSbeiDWLditNMpJq219XUHLqiKF_Dyfs0MpTltdvi8Q with valid signature
2024-07-04 00:11:50,911 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,913 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415738} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%243aurFaWCAiUX63mjMQYW_GrojrhkdTQFCVNoZpdP4xM: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,915 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 4621246
2024-07-04 00:11:50,918 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$3aurFaWCAiUX63mjMQYW_GrojrhkdTQFCVNoZpdP4xM): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,919 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $3aurFaWCAiUX63mjMQYW_GrojrhkdTQFCVNoZpdP4xM with valid signature
2024-07-04 00:11:50,922 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2020.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,924 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415732} [froscon2020.fiksel.info] Request failed: GET matrix-federation://froscon2020.fiksel.info/_matrix/federation/v1/event/%24i6Ht7jZtdNgAafeeG3PqHiqMGs4-xV0uy5Wr9y9BImM: DNSLookupError('no results for hostname lookup: froscon2020.fiksel.info')
2024-07-04 00:11:50,925 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2020.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.)); backoff now 3843873
2024-07-04 00:11:50,927 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$i6Ht7jZtdNgAafeeG3PqHiqMGs4-xV0uy5Wr9y9BImM): Failed to get PDU from froscon2020.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2020.fiksel.info.
2024-07-04 00:11:50,928 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $i6Ht7jZtdNgAafeeG3PqHiqMGs4-xV0uy5Wr9y9BImM with valid signature
2024-07-04 00:11:50,930 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54502 - Streaming: caches -> 24851850 (limited: False, updates: 1, max token: 24851850)
2024-07-04 00:11:50,935 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54503 - Streaming: caches -> 24851852 (limited: False, updates: 2, max token: 24851851)
2024-07-04 00:11:50,938 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54503 - Streaming: caches -> 24851852 (limited: False, updates: 1, max token: 24851852)
2024-07-04 00:11:50,940 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,942 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415741} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24bIlM8d0p3bdXdOsZDJcf4QfmBYUqw68rwh1yj9ltOUo: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,944 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 2720981
2024-07-04 00:11:50,945 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$bIlM8d0p3bdXdOsZDJcf4QfmBYUqw68rwh1yj9ltOUo): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,946 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $bIlM8d0p3bdXdOsZDJcf4QfmBYUqw68rwh1yj9ltOUo with valid signature
2024-07-04 00:11:50,948 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,949 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415740} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24-NwxVV1Fqyd0MWrVk04VDdE9IXn3Pn8eRiUHkmnzyb8: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,950 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 3728490
2024-07-04 00:11:50,952 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$-NwxVV1Fqyd0MWrVk04VDdE9IXn3Pn8eRiUHkmnzyb8): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,953 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $-NwxVV1Fqyd0MWrVk04VDdE9IXn3Pn8eRiUHkmnzyb8 with valid signature
2024-07-04 00:11:50,955 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,957 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415746} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24JV3LD2revd5Iw7WWdGjhhq1O5QVa7ry0asdae5xnNeY: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,958 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 3759663
2024-07-04 00:11:50,959 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$JV3LD2revd5Iw7WWdGjhhq1O5QVa7ry0asdae5xnNeY): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,961 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $JV3LD2revd5Iw7WWdGjhhq1O5QVa7ry0asdae5xnNeY with valid signature
2024-07-04 00:11:50,963 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,965 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415744} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24K-o6eMEV9Z1cGi-cezmtIiGh9fOfHFRC-IL9cZm-tok: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,966 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 4101938
2024-07-04 00:11:50,968 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$K-o6eMEV9Z1cGi-cezmtIiGh9fOfHFRC-IL9cZm-tok): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,971 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $K-o6eMEV9Z1cGi-cezmtIiGh9fOfHFRC-IL9cZm-tok with valid signature
2024-07-04 00:11:50,973 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,975 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415737} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24mYmK1IzBrSl96elUgyY2eZ8EhegzXWyFKddProyr1_w: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,976 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 2986487
2024-07-04 00:11:50,978 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$mYmK1IzBrSl96elUgyY2eZ8EhegzXWyFKddProyr1_w): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,979 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $mYmK1IzBrSl96elUgyY2eZ8EhegzXWyFKddProyr1_w with valid signature
2024-07-04 00:11:50,980 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,982 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415736} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24NUjspGmAgZ7bOvel--xPxtz6QOc2y8ZMTnXYygrZmz4: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,983 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 3335528
2024-07-04 00:11:50,985 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$NUjspGmAgZ7bOvel--xPxtz6QOc2y8ZMTnXYygrZmz4): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,986 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $NUjspGmAgZ7bOvel--xPxtz6QOc2y8ZMTnXYygrZmz4 with valid signature
2024-07-04 00:11:50,989 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,991 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415742} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24sIF0MDB0RKwZcvEwYreTXjItCp2PEDlWeApEnZ3ASWQ: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,992 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 3515805
2024-07-04 00:11:50,994 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$sIF0MDB0RKwZcvEwYreTXjItCp2PEDlWeApEnZ3ASWQ): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,995 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $sIF0MDB0RKwZcvEwYreTXjItCp2PEDlWeApEnZ3ASWQ with valid signature
2024-07-04 00:11:50,996 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:50,998 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415739} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24LZx8gsdh5Oyu63T21qjPvF-Tl0DlTiaTjkLug1_O9bA: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:50,999 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 2714248
2024-07-04 00:11:51,001 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$LZx8gsdh5Oyu63T21qjPvF-Tl0DlTiaTjkLug1_O9bA): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,002 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $LZx8gsdh5Oyu63T21qjPvF-Tl0DlTiaTjkLug1_O9bA with valid signature
2024-07-04 00:11:51,004 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,006 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415745} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24_TmMNMr5C2XU7K8td1ayyNg7nTT5CUEVh1nTouiaiJo: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:51,007 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 3812869
2024-07-04 00:11:51,008 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$_TmMNMr5C2XU7K8td1ayyNg7nTT5CUEVh1nTouiaiJo): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,010 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $_TmMNMr5C2XU7K8td1ayyNg7nTT5CUEVh1nTouiaiJo with valid signature
2024-07-04 00:11:51,012 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,013 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415743} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%248qZ4zAlwAztm5TZ3CXoCOGYhAkXtOPEr0pAIYLMo9UI: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:51,014 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 4365148
2024-07-04 00:11:51,016 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$8qZ4zAlwAztm5TZ3CXoCOGYhAkXtOPEr0pAIYLMo9UI): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,017 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $8qZ4zAlwAztm5TZ3CXoCOGYhAkXtOPEr0pAIYLMo9UI with valid signature
2024-07-04 00:11:51,019 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to froscon2019.fiksel.info:8448: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,021 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7415747} [froscon2019.fiksel.info] Request failed: GET matrix-federation://froscon2019.fiksel.info/_matrix/federation/v1/event/%24GsXFjF27BdswIXLAoEUgmenaHgyo1_N91wO2T0eC3AE: DNSLookupError('no results for hostname lookup: froscon2019.fiksel.info')
2024-07-04 00:11:51,022 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to froscon2019.fiksel.info was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.)); backoff now 4090849
2024-07-04 00:11:51,023 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$GsXFjF27BdswIXLAoEUgmenaHgyo1_N91wO2T0eC3AE): Failed to get PDU from froscon2019.fiksel.info because Failed to send request: DNSLookupError: DNS lookup failed: no results for hostname lookup: froscon2019.fiksel.info.
2024-07-04 00:11:51,025 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $GsXFjF27BdswIXLAoEUgmenaHgyo1_N91wO2T0eC3AE with valid signature
2024-07-04 00:11:51,028 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54504 - Streaming: caches -> 24851857 (limited: False, updates: 5, max token: 24851853)
2024-07-04 00:11:51,035 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54504 - Streaming: caches -> 24851863 (limited: False, updates: 10, max token: 24851857)
2024-07-04 00:11:51,039 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54504 - Streaming: caches -> 24851863 (limited: False, updates: 6, max token: 24851863)
2024-07-04 00:11:56,833 - synapse.replication.http.federation - 147 - INFO - POST-220063 - Got batch of 1 events to persist to room !iotruiWARuYNvXiTDB:kde.org
2024-07-04 00:11:56,887 - synapse.access.http.9093 - 473 - INFO - POST-220063 - 10.0.10.24 - 9093 - {None} Processed request: 0.053sec/0.001sec (0.001sec, 0.000sec) (0.000sec/0.000sec/0) 351B 200 "POST /_synapse/replication/fed_send_events/cWWMQPlNwm HTTP/1.1" "Synapse/1.109.0" [0 dbevts]
2024-07-04 00:11:56,898 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54505 - Streaming: events -> 11003819 (limited: False, updates: 1, max token: 11003819)
2024-07-04 00:11:56,924 - synapse.access.http.8008 - 473 - INFO - GET-220056 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 16.730sec/0.001sec (0.004sec, 0.002sec) (0.005sec/0.014sec/7) 1593B 200 "GET /_matrix/client/v3/sync?filter=10&since=s11003818_24589341_10766_12535872_461815_254_136477_13877260_0_93&timeout=20000 HTTP/1.0" "Mozilla/5.0" [3 dbevts]
2024-07-04 00:11:56,960 - synapse.replication.http.federation - 196 - INFO - POST-220064 - Got 'm.receipt' edu from matrix.org
2024-07-04 00:11:56,971 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54506 - Streaming: receipts -> 12535873 (limited: False, updates: 1, max token: 12535873)
2024-07-04 00:11:56,978 - synapse.access.http.9093 - 473 - INFO - POST-220064 - 10.0.10.24 - 9093 - {None} Processed request: 0.018sec/0.001sec (0.000sec, 0.002sec) (0.001sec/0.012sec/4) 326B 200 "POST /_synapse/replication/fed_send_edu/m.receipt/ysViFyIckx HTTP/1.1" "Synapse/1.109.0" [0 dbevts]
2024-07-04 00:11:57,283 - synapse.access.http.8008 - 473 - INFO - POST-220065 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 0.134sec/0.001sec (0.056sec, 0.029sec) (0.278sec/0.434sec/169) 41500B 200 "POST /_matrix/client/v3/keys/query HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:11:57,581 - synapse.access.http.8008 - 473 - INFO - GET-220066 - 0.0.0.0 - 8008 - {None} Processed request: 0.021sec/-0.000sec (0.001sec, 0.000sec) (0.000sec/0.002sec/1) 16287B 200 "GET /_matrix/media/v3/download/matrix.org/oniPNTSIvDGwpHVfjArnEgwr HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:11:57,719 - synapse.access.http.8008 - 473 - INFO - GET-220067 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 0.010sec/0.001sec (0.002sec, 0.000sec) (0.001sec/0.005sec/3) 701B 200 "GET /_matrix/client/v3/sync?filter=10&since=s11003819_24589341_10766_12535872_461815_254_136477_13877260_0_93&timeout=20000 HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:11:58,071 - synapse.access.http.8008 - 473 - INFO - POST-220068 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 0.127sec/0.001sec (0.054sec, 0.032sec) (0.296sec/0.465sec/165) 35621B 200 "POST /_matrix/client/v3/keys/query HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:11:58,090 - synapse.metrics._gc - 127 - INFO - sentinel - Collecting gc 1
2024-07-04 00:12:00,495 - synapse.http.federation.well_known_resolver - 291 - INFO - ServerKeyFetcher-2343 - Error fetching https://matrix.d0pe.eu/.well-known/matrix/server: HostnameAddress(hostname=b'matrix.d0pe.eu', port=443)
2024-07-04 00:12:00,502 - synapse.http.matrixfederationclient - 799 - INFO - ServerKeyFetcher-2343 - {GET-O-7415726} [matrix.d0pe.eu] Request failed: GET matrix-federation://matrix.d0pe.eu/_matrix/key/v2/server: TimeoutError('Timed out after 10s')
2024-07-04 00:12:00,505 - synapse.crypto.keyring - 852 - WARNING - ServerKeyFetcher-2343 - Error looking up keys from matrix.d0pe.eu: Failed to send request: TimeoutError: Timed out after 10s
2024-07-04 00:12:00,507 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $aWAap_jJHfdEGTiwA5YUCm_H2O1HLkJHpItdIEs-gGg was invalid (unable to verify signature for sender domain matrix.d0pe.eu: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='matrix.d0pe.eu', minimum_valid_until_ts=0, key_ids=['ed25519:a_MCQT'])). Checking local store/origin server
2024-07-04 00:12:00,508 - synapse.federation.federation_client - 760 - WARNING - POST-220059 - Signature on retrieved event $Hyin4YPNOVPieJLrhb38Y_PHzcbMKtSiSw_L5NiUopw was invalid (unable to verify signature for sender domain matrix.d0pe.eu: 401: Failed to find any key to satisfy: _FetchKeyRequest(server_name='matrix.d0pe.eu', minimum_valid_until_ts=0, key_ids=['ed25519:a_MCQT'])). Checking local store/origin server
2024-07-04 00:12:00,597 - synapse.logging.context - 88 - WARNING - ServerKeyFetcher-2343 - Re-starting finished log context ServerKeyFetcher-2343
2024-07-04 00:12:00,783 - synapse.logging.context - 88 - WARNING - ServerKeyFetcher-2343 - Re-starting finished log context ServerKeyFetcher-2343
2024-07-04 00:12:05,907 - synapse.replication.http.federation - 196 - INFO - POST-220074 - Got 'm.receipt' edu from matrix.org
2024-07-04 00:12:05,970 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54507 - Streaming: receipts -> 12535874 (limited: False, updates: 1, max token: 12535874)
2024-07-04 00:12:05,981 - synapse.access.http.9093 - 473 - INFO - POST-220074 - 10.0.10.24 - 9093 - {None} Processed request: 0.073sec/0.001sec (0.004sec, 0.001sec) (0.002sec/0.065sec/7) 326B 200 "POST /_synapse/replication/fed_send_edu/m.receipt/TwlaDIpSdB HTTP/1.1" "Synapse/1.109.0" [0 dbevts]
2024-07-04 00:12:05,994 - synapse.access.http.8008 - 473 - INFO - GET-220069 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 7.661sec/0.001sec (0.004sec, 0.000sec) (0.002sec/0.007sec/4) 704B 200 "GET /_matrix/client/v3/sync?filter=10&since=s11003819_24589341_10766_12535873_461815_254_136477_13877260_0_93&timeout=20000 HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:12:06,343 - synapse.access.http.8008 - 473 - INFO - POST-220075 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 0.123sec/0.001sec (0.044sec, 0.036sec) (0.311sec/0.426sec/165) 35621B 200 "POST /_matrix/client/v3/keys/query HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:12:07,120 - synapse.storage.databases.main.event_push_actions - 1396 - INFO - rotate_notifs-9667 - Rotating notifications
2024-07-04 00:12:07,125 - synapse.storage.databases.main.event_push_actions - 1599 - INFO - rotate_notifs-9667 - Rotating notifications up to: 11003819
2024-07-04 00:12:07,129 - synapse.storage.databases.main.event_push_actions - 1685 - INFO - rotate_notifs-9667 - Rotating notifications, handling 0 rows
2024-07-04 00:12:07,139 - synapse.storage.databases.main.event_push_actions - 1770 - INFO - rotate_notifs-9667 - Rotating notifications, deleted 0 push actions
2024-07-04 00:12:08,198 - synapse.util.caches.lrucache - 218 - INFO - LruCache._expire_old_entries-9667 - Dropped 0 items from caches
2024-07-04 00:12:08,347 - synapse.http.matrixfederationclient - 756 - INFO - _maybe_retry_device_resync-11613 - {GET-O-7416245} [mtrx.pro-i-l.de] Got response headers: 403 Forbidden
2024-07-04 00:12:08,348 - synapse.http.matrixfederationclient - 846 - WARNING - _maybe_retry_device_resync-11613 - {GET-O-7416245} [mtrx.pro-i-l.de] Request failed: GET matrix-federation://mtrx.pro-i-l.de/_matrix/federation/v1/user/devices/%40netimp%3Amtrx.pro-i-l.de: HttpResponseException('403: Forbidden')
2024-07-04 00:12:08,349 - synapse.handlers.device - 1417 - WARNING - _maybe_retry_device_resync-11613 - Failed to handle device list update for @netimp:mtrx.pro-i-l.de: 403: Forbidden
2024-07-04 00:12:08,481 - synapse.http.matrixfederationclient - 756 - INFO - _maybe_retry_device_resync-11613 - {GET-O-7416246} [p0457.chat] Got response headers: 404 Not Found
2024-07-04 00:12:08,483 - synapse.http.matrixfederationclient - 846 - WARNING - _maybe_retry_device_resync-11613 - {GET-O-7416246} [p0457.chat] Request failed: GET matrix-federation://p0457.chat/_matrix/federation/v1/user/devices/%40p0457%3Ap0457.chat: HttpResponseException('404: Not Found')
2024-07-04 00:12:08,484 - synapse.handlers.device - 1417 - WARNING - _maybe_retry_device_resync-11613 - Failed to handle device list update for @p0457:p0457.chat: 404: Not Found
2024-07-04 00:12:09,841 - synapse.access.http.8008 - 473 - INFO - GET-220077 - 0.0.0.0 - 8008 - {@mew:tusooa.xyz} Processed request: 0.003sec/0.001sec (0.000sec, 0.000sec) (0.000sec/0.001sec/1) 12193B 200 "GET /_matrix/client/v3/notifications HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:12:10,513 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to matrix.d0pe.eu:8448: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448)
2024-07-04 00:12:10,514 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7416078} [matrix.d0pe.eu] Request failed: GET matrix-federation://matrix.d0pe.eu/_matrix/federation/v1/event/%24aWAap_jJHfdEGTiwA5YUCm_H2O1HLkJHpItdIEs-gGg: ConnectingCancelledError(HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448))
2024-07-04 00:12:10,517 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to matrix.d0pe.eu was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: ConnectingCancelledError: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448))); backoff now 2848728
2024-07-04 00:12:10,520 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$aWAap_jJHfdEGTiwA5YUCm_H2O1HLkJHpItdIEs-gGg): Failed to get PDU from matrix.d0pe.eu because Failed to send request: ConnectingCancelledError: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448)
2024-07-04 00:12:10,522 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $aWAap_jJHfdEGTiwA5YUCm_H2O1HLkJHpItdIEs-gGg with valid signature
2024-07-04 00:12:10,525 - synapse.http.federation.matrix_federation_agent - 371 - INFO - POST-220059 - Failed to connect to matrix.d0pe.eu:8448: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448)
2024-07-04 00:12:10,526 - synapse.http.matrixfederationclient - 799 - INFO - POST-220059 - {GET-O-7416079} [matrix.d0pe.eu] Request failed: GET matrix-federation://matrix.d0pe.eu/_matrix/federation/v1/event/%24Hyin4YPNOVPieJLrhb38Y_PHzcbMKtSiSw_L5NiUopw: ConnectingCancelledError(HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448))
2024-07-04 00:12:10,528 - synapse.util.retryutils - 283 - INFO - POST-220059 - Connection to matrix.d0pe.eu was unsuccessful (<class 'synapse.api.errors.RequestSendFailed'>(Failed to send request: ConnectingCancelledError: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448))); backoff now 2967043
2024-07-04 00:12:10,530 - synapse.federation.federation_client - 526 - INFO - POST-220059 - get_pdu(event_id=$Hyin4YPNOVPieJLrhb38Y_PHzcbMKtSiSw_L5NiUopw): Failed to get PDU from matrix.d0pe.eu because Failed to send request: ConnectingCancelledError: HostnameAddress(hostname=b'matrix.d0pe.eu', port=8448)
2024-07-04 00:12:10,531 - synapse.federation.federation_client - 798 - WARNING - POST-220059 - Failed to find copy of $Hyin4YPNOVPieJLrhb38Y_PHzcbMKtSiSw_L5NiUopw with valid signature
2024-07-04 00:12:10,537 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54508 - Streaming: caches -> 24851864 (limited: False, updates: 1, max token: 24851864)
2024-07-04 00:12:10,543 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54509 - Streaming: caches -> 24851865 (limited: False, updates: 1, max token: 24851865)
2024-07-04 00:12:10,546 - synapse.http.server - 130 - INFO - POST-220059 - <XForwardedForRequest at 0x7f6a83128250 method='POST' uri='/_matrix/client/v3/join/%23FrOSCon:fiksel.info' clientproto='HTTP/1.0' site='8008'> SynapseError: 400 - No create event in state
2024-07-04 00:12:10,548 - synapse.access.http.8008 - 473 - INFO - POST-220059 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 21.521sec/0.001sec (0.083sec, 0.018sec) (0.006sec/0.027sec/20) 58B 400 "POST /_matrix/client/v3/join/%23FrOSCon:fiksel.info HTTP/1.0" "Mozilla/5.0" [18 dbevts]
2024-07-04 00:12:14,720 - synapse.replication.http.federation - 196 - INFO - POST-220078 - Got 'm.device_list_update' edu from mcld.eu
2024-07-04 00:12:14,724 - synapse.handlers.device - 1232 - INFO - POST-220078 - Received device list update for @satcom886:mcld.eu, requiring resync: False. Devices: 6lQEFfjMds
2024-07-04 00:12:14,753 - synapse.replication.tcp.resource - 215 - INFO - replication_notifier-54510 - Streaming: device_lists -> 13877261 (limited: False, updates: 1, max token: 13877261)
2024-07-04 00:12:14,760 - synapse.access.http.9093 - 473 - INFO - POST-220078 - 10.0.10.24 - 9093 - {None} Processed request: 0.039sec/0.002sec (0.004sec, 0.003sec) (0.002sec/0.024sec/6) 326B 200 "POST /_synapse/replication/fed_send_edu/m.device_list_update/GjBfpmzEaS HTTP/1.1" "Synapse/1.109.0" [0 dbevts]
2024-07-04 00:12:14,765 - synapse.access.http.8008 - 473 - INFO - GET-220076 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 8.160sec/0.001sec (0.001sec, 0.001sec) (0.002sec/0.002sec/1) 281B 200 "GET /_matrix/client/v3/sync?filter=10&since=s11003819_24589341_10766_12535874_461815_254_136477_13877260_0_93&timeout=20000 HTTP/1.0" "Mozilla/5.0" [0 dbevts]
2024-07-04 00:12:15,118 - synapse.access.http.8008 - 473 - INFO - POST-220079 - 0.0.0.0 - 8008 - {@tusooa:tusooa.xyz} Processed request: 0.128sec/0.001sec (0.072sec, 0.024sec) (0.276sec/0.448sec/168) 43511B 200 "POST /_matrix/client/v3/keys/query HTTP/1.0" "Mozilla/5.0" [0 dbevts]
tusooa commented 4 months ago

It seems like joining #matrix.to:matrix.org from a new homeserver will no longer work since the original server used to create the room (riot.ovh) is no longer operational. This means your server won't be able to obtain the server's signing keys to verify the room creation event, as well as other important state events.

You can join that room from an account on matrix.org (or any other server that already has an account which is a member of the room) since those homeservers will have already been able to obtain the signing keys necessary to verify the room's events. Any new homeserver will not be able to fetch the appropriate signing keys, and therefore will not be able to join the room properly.

So, if the server creating a room goes away, then no new homeservers can join the room? Should this be considered a bug in the spec?

devonh commented 4 months ago

So, if the server creating a room goes away, then no new homeservers can join the room? Should this be considered a bug in the spec?

That's true only if your server is not configured to use a notary server to fetch server keys. (or if the configured notary server/s doesn't/don't have the key for the appropriate server)

There is a provision in the spec that allows for "perspective/notary" key servers to provide server keys on another's behalf. (https://spec.matrix.org/v1.11/server-server-api/#retrieving-server-keys) It specifically states: intermediate notary servers should continue to return the last response they received from the server so that the signatures of old events can still be checked - which allows a notary server to perpetually provide keys on behalf of servers that have since gone offline. In this case, you would need to configure trusted_key_servers in synapse.

Have you changed the value of trusted_key_servers in your config? It defaults to matrix.org, which I believe should work as a notary server for both riot.ovh & froscon2020.fiksel.info. (which are the servers that created the rooms you mentioned) Querying the keys manually with matrix.org works as expected: curl -X GET https://matrix.org/_matrix/key/v2/query/riot.ovh