QA task: stratified random sampling

CarnegieLearningWeb / UpGrade

Framework for adding A/B testing to education applications

https://www.upgradeplatform.org/

BSD 3-Clause "New" or "Revised" License

26 stars 13 forks source link

QA task: stratified random sampling #1390

Open amurphy-cl opened 6 months ago

amurphy-cl commented 6 months ago

QA Task: Test Stratified Random Sampling algorithm in MATHia staging environment.

amurphy-cl commented 6 months ago

QA didn't fully pass. I created 10 test users and added strata. The strata upload and selection in the experiment design worked great. Variants were assigned according to Splunk (except one got an empty variant, not sure why). But none of the data (enrollment or metrics) showed up in UpGrade. Created issue: https://github.com/CarnegieLearningWeb/UpGrade/issues/1391 to track bug.