search

lukasvermeer / ab-stats

A presentation explaining the statistics behind AB-testing using live simulations
MIT License
10 stars 9 forks source link

Rephrase "measurement error" on slide 11. #2

Closed lukasvermeer closed 6 years ago

lukasvermeer commented 6 years ago

Don Green writes:

Slide 11: The third point is really more expansive than "measurement error" -- it includes all manner of excludability violations that would break the symmetry between treatment and control.

Lukas Vermeer responds:

Hm yes you are correct. I was thinking only of ill defined metrics, but randomisation failure would also be a possible explanation.

I need a good, layman's term to describe this category of potential explanations. "Violations of assumptions" seems too vague.