Does the requirement to log in before making a request decrease conversion?

[garethrees]

Q: Does the requirement to log in before making a request decrease conversion?

[Explain how you will measure this]

Measure conversion rate Don't have goals enabled but can look at /request/:url_name/new

[What do we need to do to be able to take the measurements?]

• [x] Turn off requirement to log in before making a request on AskTheEU (Done on 2016-03-09 by @lizconlan )

[garethrees]

Before (6/2/16 - 8/3/16)

• 1.56% of sessions
• 1.50% of users

After (10/3/16 - 10/4/16)

• 2.80% of sessions
• 2.70% of users

[garethrees]

https://github.com/mysociety/asktheeu-theme/issues/21

[lizconlan]

IIRC the methodology was:

• In the Analytics "Reporting" section navigate to Users > Overview
• Select the custom "Made a request" segment (defined as: Page: matches regex "^/.+/request/.+/new$")
• Set the time frame
• Harvest results

The date ranges look odd but should represent the same number of days. The skipped day is the day the change was deployed so was deliberately excluded due to the uncertainty of which version of the site was being reported.

[lizconlan]

Unfortunately the Goal Conversion data is unsuitable because there is not complete data available for the before period so the comparison will be misleading.

[Gemmamysoc]

Is it worth doing this same experiment on AskYourGov? They currently make users log-in before making a request. This would obviously require getting access to their Google Analytics beforehand though and setting up goal to track how many people make requests.

[Gemmamysoc]

No - not worth experimenting again. Let's just take it off their site.