search

bookingcom / powercalculator

Calculator to define runtime of experiments
https://bookingcom.github.io/powercalculator/
MIT License
87 stars 17 forks source link

Add multi-variant calculations for even splits #22

Closed sebsasto-bkg closed 5 years ago

sebsasto-bkg commented 5 years ago

I added multi-variant calculations for even splits in the power calculator. This is using Sidak's correction in the alpha value. This change includes:

  1. In the interface the users can select the number of variants and if they want to compare all variance with base or just one variant.
  2. Additional the users now can hide the daily traffic if they don't consider necessary to use it.
  3. For non-inferiority tests the absolute and relative impact is now showed at the same time.
  4. All the scientific test were updated to test with multiple variants.

TODO: Add more tests in the store to consider multiple configurations.

chadadavis commented 5 years ago

@sebsasto-bkg , you're an admin now, if you want to merge this now (?)