User testing

[MHemsley]

Hi @MatteoTurco,

Just wanted to add a bit of guidance towards the user testing. The key things to consider within this context:

Is there a clear journey through the app? Are there any pain points(difficulties in use mainly to do with the flow)? Is anything unclear? Do the young people/clinicians like the visual style, do they feel it is appropriate for the app? Is it clear how the app should/could be used, and how to flow through it? Is there anything that needs to be added to make people use it? Is it clear how it would work within Chrome? Would they use it?

A couple of useful links that have been floating around the other repos - https://www.youtube.com/watch?v=U9ZG19XTbd4

https://library.gv.com/the-gv-research-sprint-finalize-schedule-and-complete-interview-guide-day-3-b8cddb8f931d#.gwy9gtulg

[msachi]

Hi @MatteoTurco, please find attached the guidelines that we used for our user-testing of an app intended for online donations. Obviously this will not be directly relevant for this app, but I think some of the general tips are useful.

In the case of our app, I would ask the users some questions about their social media habits (how much time they spend on them, how they feel about it...) Could also probe some questions that would be useful technically, e.g. what are their favourite social media platforms, what technologies they use (mobile, desktop), have they ever used a Chrome extension etc. If you will be interviewing a 'general' young population, then I think adding questions about their self-esteem, susceptibility to anxiety / negative thoughts etc. would also be very important.

[msachi]

@MatteoTurco

Guidelines for our previous app

Plan your testing

• 4-6 people
• 2 people: 1 note taker, 1 researcher
• Listen, don't give / influence answers
• Don't tell them what to do

Introductions (names etc.)

• neutral, experiment, no right / wrong

Ice-breakers

• Have you made online payments before?
• Can you think of any particularly good experiences with the payment process?
• Can you think of any particularly bad experiences with the payment process?

Testing

• Explain company
• Imagine you are an alumni looking to donate to Future Leaders, please try to make a donation using card payment on the website
• I want you to talk out loud
• Share your thought process with us and any reflections as you go
• There are no wrong or right answers

If someone asks you for help say:

• Is that what you think you would do? So what would you do next?
• Identify where people are confused

Afterwards

• How does the website make you feel?
• Things that stood out to you?
• What were the best and worst parts?
• Was there anything else you wish you could have done after completing your payment?

Background - Discoverability

• Have you ever donated online?
• Who have you donated through before?
• Age approximation

[msachi]

@MatteoTurco At the moment the Chrome extension part of the user journey is mocked, i.e. we downloaded a Facebook page and embedded the content (i.e. a button that redirects them to our app) into it. I'm not sure how to best present this to users, the options I see are:

• show them our mock for the FB page (see below), then ask them to interact with our app
• let them scroll through their own Facebook feed, then ask them to use the app (explain that in the real app there will be a button that will lead them there)

You can find the Facebook mock file here: https://drive.google.com/open?id=0B8AZzKBEpd9vV3BjUTRfWmtkY0E

Just download it and open in any Browser. The user can navigate to our app by clicking the 'Felling low button / logo'. Let us know if you have any problems.

[MatteoTurco]

Thank you all for the useful information. I have tailored the questionnaire accordingly, and included a Likert scale to assess the subjective experienxe of self-esteem.

I look forward to collecting the data and presenting it on Thursday.