openfoodfoundation / inception-pipe

The inception pipe manages the product, design & tech work that happens prior to an issue enters the delivery pipe.
1 stars 0 forks source link

Mobile UX - Usertesting #7

Closed Erioldoesdesign closed 3 years ago

Erioldoesdesign commented 3 years ago

Mobile UX is steadily being deployed across instances and there is a need to ensure that it is performing how we expected when we decided on the improvements. This is best done, from a designer point of view, through a mix-research approach including metrics/number analytics and user research, potentially best facilitated through user testing sessions.

A decision on the Personas we test with will help inform the user research portion of this work.

Some initial measurement criteria (metrics/numbers based)taken from the Mobile UX epic:

Some (WIP) elements to explore through user testing:

Notes for testing:

Erioldoesdesign commented 3 years ago

Usertesting script is located: https://www.notion.so/openfoodnetwork/Mobile-UX-Usertesting-bd8acdcc2071476dbae9511e9de26ce8

Did a rush on this script because I had an extra 3 people sign up for the 'Next buttons' test so I wanted to spread out testing insight.

Erioldoesdesign commented 3 years ago

Closing this issue out with 'opening up all the research notes' here.

Test plan and script

Target User

Test with max 5 users who are likely to be regular and reasonably proficient online shoppers for food and/or groceries. They don't need to be experts in online shopping, but know it exists and have placed at leas one shopping order within the last 3-6 months.

Alternatively, we want to test with people who do not regularly shop online for food or groceries but do visit local markets, farmers markets, local delis, local food hubs or specialist shops e.g. Asian markets, dietary specialists, ethnic or regional specialists.

Notes for testing:

Housekeeping questions

Light preamble

We're testing an online mobile experience which is centred generally around making purchases online and specifically around purchasing consumable food, produce or groceries. We'd like to ask if you're happy to set up a virtual mobile view on your browser before we begin. This can most easily be done with the 'Chrome' browser if you are familiar with it? (Chrome is a red, yellow and green circle icon and is most common on chrome books and android or google devices.

If you're unfamiliar or do not have this browser which browser do you typically use to access the internet? Investigate the set up for Safari, IE, FireFox and Opera.

I’ll ask you some questions about your online shopping behaviours first, then to complete 2 tasks and then ask some general questions at the end, if that’s alright. The test should not take longer than 45 minutes.

You have no need to feel pressure here, we’re testing the designs, not you, so don’t be afraid to explore and speak your mind. You don’t need to worry about hurting our feelings. We have very thick skin, so don’t be afraid to be brutally honest.

It helps a lot for our analysis if you can think out loud and describe what you’re doing as much as possible while you’re browsing the test website. e.g. I'm thinking about clicking this button but I'm not sure what it does, or I'm reading this text and trying to understand the meaning or I want to find more detailed info and I'm looking for that right now.

If at any point you choose to stop the session, that’s absolutely fine. Just let me know.

Mobile behaviour

  1. If you don't mind telling us, what mobile device and browser do you commonly use?
  2. Do you use the internet browser often on your mobile device?
  3. And for what kinds of needs? e.g. shopping, information, reading, apps, social media etc. What are your 3 most performed activities?

Setting the scene questions

  1. How do you buy groceries for you or your household?
  2. Are you solely responsible for food purchases or is it a shared task? How much influence do you have over the food in your household?
  3. Do you plan your grocery shopping? If yes, how do you plan and conduct your grocery shopping?
  4. Do you have a preferred place to get groceries?
  5. What factors (if any) come into play when considering a new place to purchase food or groceries from?
  6. How often (if at all) do you purchase groceries online?
  7. Do you have any regular subscriptions to food or essentials? If yes, what kinds of items?
  8. How much time do you typically spend thinking about where your food comes from? How about before your last food purchase? or if they struggle: How would you describe your food purchasing habits? In 3-6 words.
  9. Finally, have you heard of 'The open food network' before?

Deeper preamble

We're going to be looking at the Open Food Network today, We'll default to the UK site unless there is an operational OFN in your country of residence. Open Food Network operates in a number of different countries with some unique aspects across them.

We'll be looking specifically on a virtual mobile view, so I'd like you to think about and try to simulate the experience of mobile browsing as best you can while on your computer viewing a mobile screen. You might want to think about where you are physically when you use mobile websites, what else you're doing when you view mobile websites or any other criteria that might be important when you use your mobile to view websites.

Tasks

  1. I want you to think of some grocery items you're thinking of purchasing in your next food shop. Think of and write down a maximum of 5 items you'd like to buy. These can be essentials or non-essentials if you want them. Don't worry, you can change these items if you need to.

  2. Using https://openfoodnetwork.org.uk/ I'd like you to attempt to find these items. Please stop before you finalise any orders e.g. please do not click on any buttons that say 'place order now' :)

    Please note: if you're testing with testers that are not UK based they may need the £ to their currency exchange rates which are roughly:

    £1.00 = USD 1.36

    £1.00 = EUR 1.12

    £1.00 = CAD 1.74

    £1.00 = AUS 1.77

    £1.00 = INR 99.74

    Using https://www.xe.com/

    1. If the tester is non-UK based then you can have, 1- 'Cornwall', 2- 'Kent', 3- 'Birmingham', 4- 'Norfolk' as a reference point for location.
    2. Some good shops to direct the tester to are:
    3. https://openfoodnetwork.org.uk/cusgarne-organic-farm/ for groceries and order cycles
    4. https://openfoodnetwork.org.uk/kehelland-trust-food-hub for flowers and plants
    5. https://openfoodnetwork.org.uk/helston-local-food-hub for food bank donations and vegetables
    6. https://openfoodnetwork.org.uk/kent-food-hubs-folkestone/shop - Deli and household
    7. https://openfoodnetwork.org.uk/kent-food-hubs-ashford/shop - Same as above but via order cycles and testing 'member' language.
    8. https://openfoodnetwork.org.uk/slow-food-birmingham/shop for food bank donations
    9. https://openfoodnetwork.org.uk/algy-s-farm-shop/ for general veg
    10. https://openfoodnetwork.org.uk/eriol-farmer for going through a purchase and checkout experience.
  3. Can you tell me what you think of this page? (likely to be an about page of a store) and the information presented?

  4. Can you tell me what you would do next?

  5. IF ORDER CYCLE SELECTION IS NEEDED Can you tell me what you think this part means? - after answering and puzzling it out you can tell the tester how to select an order cycle in order to get a list of products.

    1. Can you talk to me about what these selection options mean to you?
  6. Where would you click or go to get more information?

  7. IF THE TESTER GETS A LIST OF PRODUCTS Now you have a list of products can you see if you can find what you want to purchase from the start of our conversation and see if you can find what you need?

  8. HOPEFULLY TESTER SHOULD GO THROUGH AN ADDING PROCESS

  9. AT SOME POINT THE TESTER MIGHT FIND A 'BULK' ITEM. YOU CAN FREEFORM THE QUESTION HERE AND ASK: What do you think is happening here? or what have you noticed that is different?

  10. Can you tell me what you think of the prices compared to the typical way you shop?

  11. What information is helping you make choices to 'add' to your cart?

  12. Is there any information missing that you're thinking of from this page?

As we begin to wrap up the process of shopping I'd like to ask some summary questions

General feedback

  1. Based off the experience you've have today, how likely do you think you'd be to actually make this purchase?
  2. What factors are important for you in making the decision to confirm this purchase?
  3. What is missing for you? (if anything)
  4. What stand as out as the best part?
  5. What do you think overall?
  6. Were there any parts of the process that were confusing or difficult?

End the test and say thank you :)

Usertester 1 notes

Located in USA NY.

Typed notes:

Tasks

Key Insights and suggestions:

Usertester '2' notes.

Located in USA WDC.

Typed notes:

Task

Key Insights:

Usertester '3' notes

Located in USA TX.

Typed notes:

Task

Key Insights:

Usertester '4' notes

Located in USA.

Typed notes:

Tasks

Key Insights:

Usertester '5' notes

Located in Eastern Europe.

Typed notes:

Tasks

Key Insights:


The Mobile UX testing round 1 did not answer all the key questions from the mobile UX epic so a second round is needed.

Testing effectively with users on mobile using chrome and virtual mobile doesn't really work. We should consider using https://lookback.io/ or a similar service if we need to test remotely still. If remote is not needed then we can do in-person mobile phone tests.

Mobile UX user testing round 2 will be located here: https://www.notion.so/openfoodnetwork/Mobile-UX-Usertesting-Round-2-40f4f033c8534039a041429cc87a2238