On the first PlanningAlerts email we're doing an A/B test between two different subject lines. These are the results after running the experiment for a bit under 4 hours:
For version A: Sent to 6507. Clicked a link in the email: 72
For version B: Sent to 6507. Clicked a link in the email: 62
When we look at donations coming through to donorbox we see:
Version A: total donations so far 1142
Version B: total donations so far 648
But the number of donations is actually very similar. The difference is made by just 2 donations in version A that are for larger amounts. So, I don't think we can extrapolate anything from this currently
On the first PlanningAlerts email we're doing an A/B test between two different subject lines. These are the results after running the experiment for a bit under 4 hours:
Using https://neilpatel.com/ab-testing-calculator/ this gives an 81% confidence that A is better than B which is not yet statistically significant.
When we look at donations coming through to donorbox we see:
But the number of donations is actually very similar. The difference is made by just 2 donations in version A that are for larger amounts. So, I don't think we can extrapolate anything from this currently