search

axisgroup / evaluation-toolkit

WIP that captures Axis Group's framework for evaluating dashboards during quick design sprints
MIT License
8 stars 6 forks source link

Find a place for this content, dress it up #67

Open manasvil opened 6 years ago

manasvil commented 6 years ago

Putting a stake in the ground

WIP

— so many decisions can seem overwhelming

— but in reality goals and constraints help determine direction

— we are testing for diagnostic reasons not scientific so it is okay to use hybrid methods without too much rigidity

— we are testing overall UX not a very specific part, so it is okay to have broad open ended taks

— sample size is limited

Moderated or Unmoderated?

One of the first questions usability testers ask is whether or not it should be moderated. While there are a lot of good reasons for unmoderated tests, for prototype tests we recommend moderation. Given the “incomplete” nature of prototypes, chances are that users will have questions about the UI that a moderator will have to answer.

Another common mistake in testing is to stop or alter the test if the user experiences difficulty. Since the goal of usability testing is to find and solve difficulties, this situation could actually make the test a success. If, for example, the user strays off onto paths that haven’t been developed yet in the prototype, you could ask them why they went there and what they would have liked to accomplish. A few follow-up questions about the obstacles may yield more valuable feedback than a user with a “perfect run”.

https://drive.google.com/file/d/0BwLVd0W-_5qwU0J4TjBCa1ZCSjg/view

manasvil commented 6 years ago

Categorical extremes such as controlled study or hallway testing