Closed Erioldoesdesign closed 3 years ago
Usertesting script is located: https://www.notion.so/openfoodnetwork/Mobile-UX-Usertesting-bd8acdcc2071476dbae9511e9de26ce8
Did a rush on this script because I had an extra 3 people sign up for the 'Next buttons' test so I wanted to spread out testing insight.
Test with max 5 users who are likely to be regular and reasonably proficient online shoppers for food and/or groceries. They don't need to be experts in online shopping, but know it exists and have placed at leas one shopping order within the last 3-6 months.
Alternatively, we want to test with people who do not regularly shop online for food or groceries but do visit local markets, farmers markets, local delis, local food hubs or specialist shops e.g. Asian markets, dietary specialists, ethnic or regional specialists.
Notes for testing:
Housekeeping questions
Light preamble
We're testing an online mobile experience which is centred generally around making purchases online and specifically around purchasing consumable food, produce or groceries. We'd like to ask if you're happy to set up a virtual mobile view on your browser before we begin. This can most easily be done with the 'Chrome' browser if you are familiar with it? (Chrome is a red, yellow and green circle icon and is most common on chrome books and android or google devices.
If you're unfamiliar or do not have this browser which browser do you typically use to access the internet? Investigate the set up for Safari, IE, FireFox and Opera.
I’ll ask you some questions about your online shopping behaviours first, then to complete 2 tasks and then ask some general questions at the end, if that’s alright. The test should not take longer than 45 minutes.
You have no need to feel pressure here, we’re testing the designs, not you, so don’t be afraid to explore and speak your mind. You don’t need to worry about hurting our feelings. We have very thick skin, so don’t be afraid to be brutally honest.
It helps a lot for our analysis if you can think out loud and describe what you’re doing as much as possible while you’re browsing the test website. e.g. I'm thinking about clicking this button but I'm not sure what it does, or I'm reading this text and trying to understand the meaning or I want to find more detailed info and I'm looking for that right now.
If at any point you choose to stop the session, that’s absolutely fine. Just let me know.
Mobile behaviour
Setting the scene questions
Deeper preamble
We're going to be looking at the Open Food Network today, We'll default to the UK site unless there is an operational OFN in your country of residence. Open Food Network operates in a number of different countries with some unique aspects across them.
We'll be looking specifically on a virtual mobile view, so I'd like you to think about and try to simulate the experience of mobile browsing as best you can while on your computer viewing a mobile screen. You might want to think about where you are physically when you use mobile websites, what else you're doing when you view mobile websites or any other criteria that might be important when you use your mobile to view websites.
Tasks
I want you to think of some grocery items you're thinking of purchasing in your next food shop. Think of and write down a maximum of 5 items you'd like to buy. These can be essentials or non-essentials if you want them. Don't worry, you can change these items if you need to.
Using https://openfoodnetwork.org.uk/ I'd like you to attempt to find these items. Please stop before you finalise any orders e.g. please do not click on any buttons that say 'place order now' :)
Please note: if you're testing with testers that are not UK based they may need the £ to their currency exchange rates which are roughly:
£1.00 = USD 1.36
£1.00 = EUR 1.12
£1.00 = CAD 1.74
£1.00 = AUS 1.77
£1.00 = INR 99.74
Using https://www.xe.com/
Can you tell me what you think of this page? (likely to be an about page of a store) and the information presented?
Can you tell me what you would do next?
IF ORDER CYCLE SELECTION IS NEEDED Can you tell me what you think this part means? - after answering and puzzling it out you can tell the tester how to select an order cycle in order to get a list of products.
Where would you click or go to get more information?
IF THE TESTER GETS A LIST OF PRODUCTS Now you have a list of products can you see if you can find what you want to purchase from the start of our conversation and see if you can find what you need?
HOPEFULLY TESTER SHOULD GO THROUGH AN ADDING PROCESS
AT SOME POINT THE TESTER MIGHT FIND A 'BULK' ITEM. YOU CAN FREEFORM THE QUESTION HERE AND ASK: What do you think is happening here? or what have you noticed that is different?
Can you tell me what you think of the prices compared to the typical way you shop?
What information is helping you make choices to 'add' to your cart?
Is there any information missing that you're thinking of from this page?
As we begin to wrap up the process of shopping I'd like to ask some summary questions
General feedback
End the test and say thank you :)
Located in USA NY.
Typed notes:
Tasks
Key Insights and suggestions:
Located in USA WDC.
Typed notes:
Task
Key Insights:
Located in USA TX.
Typed notes:
Task
Key Insights:
Located in USA.
Typed notes:
Tasks
Key Insights:
Located in Eastern Europe.
Typed notes:
Tasks
Key Insights:
The Mobile UX testing round 1 did not answer all the key questions from the mobile UX epic so a second round is needed.
Testing effectively with users on mobile using chrome and virtual mobile doesn't really work. We should consider using https://lookback.io/ or a similar service if we need to test remotely still. If remote is not needed then we can do in-person mobile phone tests.
Mobile UX user testing round 2 will be located here: https://www.notion.so/openfoodnetwork/Mobile-UX-Usertesting-Round-2-40f4f033c8534039a041429cc87a2238
Mobile UX is steadily being deployed across instances and there is a need to ensure that it is performing how we expected when we decided on the improvements. This is best done, from a designer point of view, through a mix-research approach including metrics/number analytics and user research, potentially best facilitated through user testing sessions.
A decision on the Personas we test with will help inform the user research portion of this work.
Some initial measurement criteria (metrics/numbers based)taken from the Mobile UX epic:
Some (WIP) elements to explore through user testing:
Notes for testing: