protocol / prodeng

Issues, discussions and documentation from the production engineering team
2 stars 1 forks source link

Thunderdome: Continuous Release Comparisons #26

Open iand opened 2 years ago

iand commented 2 years ago

What Is It?

Run a continuous experiment comparing latest versions of each gateway implementation.

Deliverables

Why Are We Doing It?

A side by side comparison of different gateways has never been done before and the results could be very informative to implementors. It also showcases that there a multiple compatible implementations of the gateway spec. By running a continuous shootout we provide an incentive for performance improvements in each implementation and for cross-learning between teams.