federation transactions failing signature authentication with synapse

[ashkitten]

Background information

• Dendrite version or git SHA: 0.13.1
• SQLite3 or Postgres?: postgres
• Running in Docker?: no
• go version: 1.20.5
• Client used (if applicable):

Description

• What is the problem: my dendrite server always receives HTTP 401 responses from my synapse server when sending a federation transaction.
• Who is affected: my dendrite server (nyrina.link) and my synapse server (kity.wtf)
• How is this bug manifesting: kity.wtf keeps spitting out messages like this in logs:

  Jul 25 21:47:05 steve synapse[2031445]: synapse.federation.transport.server._base: [PUT-5553614] authenticate_request failed: 401: Invalid signature for server [nyrina.link](http://nyrina.link/) with key ed25519:oHl6VZ: Unable to verify signature for [nyrina.link](http://nyrina.link/): <class 'nacl.exceptions.BadSignatureError'> Signature was forged or corrupt
  Jul 25 21:47:05 steve synapse[2031445]: synapse.http.server: [PUT-5553614] <XForwardedForRequest at 0x7fc52ac6ef20 method='PUT' uri='/_matrix/federation/v1/send/1689438905736-1' clientproto='HTTP/1.1' site='8448'> SynapseError: 401 - Invalid signature for server [nyrina.link](http://nyrina.link/) with key ed25519:oHl6VZ: Unable to verify signature for [nyrina.link](http://nyrina.link/): <class 'nacl.exceptions.BadSignatureError'> Signature was forged or corrupt

  meanwhile nyrina.link only has this in (debug level) logs:

  Jul 26 03:15:12 xenia dendrite[230252]: time="2023-07-26T03:15:12.583817125Z" level=debug msg="Sending transaction \"1690338729600-1\" containing 50 PDUs, 100 EDUs" server_name=[kity.wtf](http://kity.wtf/)
  Jul 26 03:15:12 xenia dendrite[230252]: time="2023-07-26T03:15:12.748215964Z" level=debug msg="Transaction failed with HTTP401"

• When did this first appear: 2023-07-10, maybe. this is the earliest timestamp i can find in the json event contents of HTTP requests intercepted by wireshark on the loopback interface (post tls termination) of kity.wtf. at the time, i was running dendrite 0.12.0 and upgraded on 2023-07-15 after noticing the issue.

Steps to reproduce

• be me
• 🤷🏻‍♀️

i can send wireshark captures over matrix if it would help, or any other debugging steps.

[S7evinK]

(bug upstream, because it is more than likely this is a bug in matrix-org/gomatrixserverlib)

[nakal]

My Dendrite server does not federate with some Synapse servers, either. At least 2 people don't see my messages in a chat I am taking part in. I see theirs though.

Not sure how to ask them for logs on their Synapse servers, because they don't see my messages.

Dendrite version: 0.13.1 (FreeBSD package)