Cannot Accept Private Room Invite from Homeserver

[ghost]

Background information

• Dendrite version or git SHA: 0.11.0
• Monolith or Polylith?: monolith
• SQLite3 or Postgres?: Postgres
• Running in Docker?: Yes
• go version: N/A
• Client used (if applicable): Element Desktop/Web

Description

• What is the problem: I am unable to fully open a private room with users on any other homeserver.
• Who is affected: My homeserver user (@eglo:humble.cafe) and my matrix.org user (@eglo:matrix.org).
• How is this bug manifesting: Errors in the logs state that there is an "Invalid request signature" from "matrix.org" and when attempting to accept the invite it fails.
• When did this first appear: As soon as I attempted to test user-to-user message federation.

Steps to reproduce

• Open Element Desktop, logged into @eglo:humble.cafe
• "Start a new chat"
• Type @eglo:matrix.org, and click "Go"
• The chat opens and I send a message to initiate the invite.
• On Element Web logged into @eglo:matrix.org I attempt to accept the invite, and either receive a generic "Failed" error or a 401 error.

Error message in Element Web (sometimes): MatrixError: [401] Unauthorized (https://matrix-client.matrix.org/_matrix/client/r0/join/!hRJHJXZjnzcKPUl8%3Ahumble.cafe)

Messages from homeserver:

dendrite-monolith-1  | time="2023-01-29T16:15:14.706481062Z" level=info msg="Invalid request signature" error="Bad signature from \"matrix.org\" with ID \"ed25519:a_RXGa\"" req.id=FjOiqoaRJBMH req.method=GET req.path="/_matrix/federation/v1/make_join/!hRJHJXZjnzcKPUl8:humble.cafe/@eglo:matrix.org"

[Cynosphere]

Dendrite: 689b5ee72fe2ff6226c2afc5b209889f772f0819 Monolith or Polylith: Monolith SQLite3 or Postgres: Postgres Docker: No go version: 1.19 Client: Element

I'm having a more isolated version of this issue, only one homeserver (a friend's) is having this issue with any request. They're running Synapse.

Them trying to invite me to a space:

level=debug msg="Got keys from fetcher" fetcher="perspective server matrix.org" num_keys_fetched=1 req.id=m8cggHNm3ggj req.method=GET req.path=/_matrix/federation/v1/query/profile
level=info msg="Invalid request signature" error="gomatrixserverlib: key with ID \"ed25519:a_gijt\" for \"matrix.n2.pm\" not valid at 1678987384315" req.id=m8cggHNm3ggj req.method=GET req.path=/_matrix/federation/v1/query/profile

Occasional federation event failing:

level=debug msg="Requesting keys from fetcher" fetcher="perspective server matrix.org" num_key_requests=1 req.id=kvVNEZaI3G4B req.method=PUT req.path=/_matrix/federation/v1/send/1678986094906
level=debug msg="Got keys from fetcher" fetcher="perspective server matrix.org" num_keys_fetched=1 req.id=kvVNEZaI3G4B req.method=PUT req.path=/_matrix/federation/v1/send/1678986094906
level=info msg="Invalid request signature" error="gomatrixserverlib: key with ID \"ed25519:a_gijt\" for \"matrix.n2.pm\" not valid at 1678988973627" req.id=kvVNEZaI3G4B req.method=PUT req.path=/_matrix/federation/v1/send/1678986094906

[Cynosphere]

Bumping again. I've upgraded to 23cd7877a14bca5315467591cd47a7d51aec22ce the other day. I'm not getting any "Invalid request signature" errors anymore, but I'm still "netsplit" from matrix.n2.pm. My homeserver can send requests fine, but incoming from that homeserver is still returning 401 Unauthorized.

Something I noticed though when re-reading this issue is that both affected homeserver domains are .cafe domains, which is strange that this seems to be an issue. I've been suggested by a friend to try "aliasing" to a different domain but I am very hesitant to break things.