Mn/ad ab testing

[MagdaN]

First, very simple version for A/B Testing:

1. add new A/B Test in Django admin with action being an url e.g /spenden/?pk_campaign=request-message
2. In cms add A/B Test Plugin with child A/B Test variants
3. click the button a couple of times
4. see statistics on change-view of AB Test in Django admin

Possible improvements:

• In order to always show the same variant to the same user the shown variant could be saved in session
• If the redirect is not optimal (e.g. problems with browser back button) the event could be saved with js or middleware (?)

[stefanw]

Looks simple enough. However, I'm still wondering how will we track user actions? (they are not supposed to click the current form button, I guess)?

Wagtail CMS has an A/B testing app, maybe that can be an inspiration.

But to zoom out a bit: are we really building this ourselves? Should we try out a product analytics software like PostHog (see their page on experiments)?

And (of course) to zoom out further: who will be running these experiments later? Should we talk with them first (may be wait for our new hires)? Are we at the stage that we squeeze out some more percentages in conversions or are there still obvious improvements we can do? Ideally, I'd talk about these questions first before we commit to an implementation.