Closed scottf closed 1 year ago
Recently I brought up the same rough idea since it seems to be a fairly common question. Were you thinking something akin to gRPC's a dashboard?
I was just thinking that it would be useful to have a benchmark algorithm defined so it could be implemented in all languages and we could compare apples to apples, even if the apples were different varieties.
The rtt, is simply a server ping, the amount of time it takes for the client to get a response back - so using the clients flush()
and timing it should be sufficient.
This is not for RTT.
Closing due to lack of interest
Overview
It would be useful to define a benchmarking standard that all clients can implement. This means that we should define things like what constitutes a round trip, where timing points are what payload sizes are, what type of consumers to use etc.
The idea being that all clients could then implement something to this standard so the test can legitimately compare performance between languages.
AFAIK, the Java client and the CLI have significant benchmarking suites.