search

shane-kercheval / shiny-ab-testing

A shiny app for analyzing AB tests
3 stars 1 forks source link

AB test calculator uses historical conversion rates for entire site, not individual paths #3

Open shane-kercheval opened 5 years ago

shane-kercheval commented 5 years ago

Currently, the calculator uses the historical conversion rates across the entire site.

This doesn't take into consideration that different paths/urls will have different conversion rates.

shane-kercheval commented 5 years ago

get_historical_conversion_rates() currently does not either take a path(s) as a parameter or break down the rates by all paths

if the function were to take path(s) as a parameter, it would have to be removed from the processing_engine.R calculated in the reactive({}) function

alternatively, it could automatically return a table that includes breakdown by path (in addition to overall rates), but this might be considerably slower. However, if we left it in processing_engine.R it wouldn't matter, and it would still be fast to use/load.