paritytech / polkadot-stps

Polkadot Standard Transactions Per Second (sTPS) performance benchmarking
The Unlicense
14 stars 4 forks source link

sending transactions from pods #32

Open bernardoaraujor opened 1 year ago

bernardoaraujor commented 1 year ago

@pepoviola has mentioned that zombienet allows us to send the transactions from the same pod where the target node is running.

we should use this issue to discuss and brainstorm a few things:

bredamatt commented 1 year ago

This would also relate to Versi based deployments, and indeed it is an interesting question.

IMO it is a good idea for measuring a maximum (s)TPS number which is core to the measurement, but is not very realistic. In practice, RPC clients may be located in different locations than nodes. In other words, transactions may be signed in a more distributed manner where there is some latency between validator / collator nodes and submitters of transactions.

This realistic scenario can be introduced by using the chaos mesh we have in Versi, whilst still maintaining the desired deployment strategy (i.e. on the same VM / kubernetes node as the validator/collator nodes). This way we can report metrics which are both theoretically maxima, and more realistic.