[QoS] Ensure returned id fields in JSON-RPC match the requested id field

Objective

Sometimes when nodes experience issues they can return an ID field that is inconsistent with the requested ID field. QoS should filter these responses and trigger a retry when this behavior is detected.

Origin Document

Originally raised in a ticket in discord: https://discord.com/channels/824324475256438814/1284063416826462249

call:

curl $BASE \
  -X POST \
  -H "Content-Type: application/json" \
  --data '{"method":"eth_blockNumber","params":[],"id":1,"jsonrpc":"2.0"}'

response: {"jsonrpc":"2.0","id":1430873,"result":"0x12cefc9"}

testing with "id":6 call:

curl $BASE \
  -X POST \
  -H "Content-Type: application/json" \
  --data '{"method":"eth_blockNumber","params":[],"id":6,"jsonrpc":"2.0"}'

response: {"jsonrpc":"2.0","id":6,"result":"0x12cf010"}

Note the inconsistency in the first eth_blockNumber between the id fields versus the second example.

Goals

When detecting this behavior, trigger an error and penalize the node in QoS ranking
Automatically retry the request with a different node (next highest in QoS ranking)

Deliverables

Implementation of this check with penalization/retry loop

Non-goals / Non-deliverables

Any additional QoS checks or request/response body screening

General deliverables

Documentation: Update QoS documentation to show that this check exists inline.

Creator: @fredteumer

buildwithgrove / path