search

boudicca-events / boudicca.events

Event Aggregation/Publishing System
https://boudicca.events
GNU General Public License v3.0
29 stars 8 forks source link

UserTests #289

Open Yolgie opened 7 months ago

Yolgie commented 7 months ago

Plan, execute and evaluate the results of usertests. Create tickets with improvements. Document learnings to make repetition easier.

Focus on: First time user experience ("understanding what kind of page am i on", Expectation Management), A11Y, ease of use, expected information

Notes: Maybe contact/coordinate with andererseits.org / Integriert Studieren / other Update Social Projects / ...

mahdikhashan commented 5 months ago

this issue can be followed from #336.

mahdikhashan commented 5 months ago

as we discussed in todays daily, I'll cooperate in this issue by writing user tests (stories) wrt a11y.

mahdikhashan commented 5 months ago

resolves #327

mahdikhashan commented 5 months ago

regarding the user tests, it is written here in the first comment that center it around "first time user expereince", since I'm research about a11y user tests, should it be like usability tests which we can plan and execute with real potential users?

mahdikhashan commented 5 months ago

any lead or contact information from andererseits.org would be appreciated.

mahdikhashan commented 5 months ago

Usability Testing for A11Y:

Goal(s):

  1. Understanding what kind of page am i on
  2. Expectation management (@Yolgie @kadhonn could you elaborate more on this?)

Scopes:

  1. Perceivable - people with disabilities can actually access the information via sight, sound and touch. The information is sensed by the person's brain.
  2. Operable - people with disabilities can actually interact with the functionality of the system. Can use forms, controls and navigation.
  3. Understandable - people with disabilities can comprehend the content and the interface. They describe the system as useful, predictable and helpful.
  4. Robust - the content and functionality of the system work reliably with assistive technology.
  5. Task Success Rate - people with disabilities were able to complete each task. The success rate is quantified based on the users satisfaction level using the following 4 point scale: (0) satisfied, (1) neutral, (2) frustrated/angry, (3) unable to complete task.

Target groups:

  1. Visual - legally blind and low vision
  2. Tactile/Motor - unable to use a mouse (keyboard only) and tremors
  3. Cognitive - focus, memory, perception, executive function. WCAG 2.0 AA does not require that sites be made usable for people who do not have the equivalent of a 9th grade comprehension level. 9th grade, often referred to as freshman year in the United States, is normally a student aged 13 or 14.

Test subject plan:

1. Visual (Blind)

Disability:

Possible Scenario: Screen readers

2. Low Vision

Disability:

3. Colorblind

Possible Scenario: scientific methods/tools to reliably insure that the content meets the needs of the colorblind (monochrome screens)

4. Tactile

Disability:

Possible Scenario: Assistive Devices (integreirt studiren)

5. Cognitive (Focus, Perception, Memory, Executive Function)

Disability:

Possible Scenario: ??? @darwiroba maybe you have ideas?

Developing Test Documents And Questionnaire:

TODO (@darwiroba would you be happy to help with it?)

Analyze Test Results

TODO

Tickets for improvements

  1. test with monochrome screens (https://github.com/boudicca-events/boudicca.events/issues/413)
  2. manually test the a11y before conducting the user test to make sure there are no fundamental violations (https://github.com/boudicca-events/boudicca.events/issues/336#issuecomment-2017661374 and https://github.com/boudicca-events/boudicca.events/issues/414)
  3. automate a11y test (quality gate, done)

@Yolgie @kadhonn do you know if any national association in Austria exists to help with recruiting disabled people for our tests?

mahdikhashan commented 5 months ago

I did the manual testing for colorblind subject plan and the results and report is available here. I have also added documented the test case with the steps and tools I used under docs/test/ACCESSIBILITY.md.

mahdikhashan commented 4 months ago

I documented the manual testing with screen reader using NVDA in shared google drive under accessibility/Screen Reader Manual Testing - NVDA.pdf.

mahdikhashan commented 4 months ago

I documented the prompts I have used to generate test scenarios for the the previous comment in the shared google drive under accessiblity/Screen Reader Manual Testing Test Scenario Prompts for ChatGPT3.5.pdf.

mahdikhashan commented 4 months ago

regarding the event elements region of the page, attached links is an accessibility research done by a team of engineers, UX experts and tester to find a diverse solution to live-regions or load more content feature.

link: https://www.gatsbyjs.com/blog/2019-07-11-user-testing-accessible-client-routing/

kadhonn commented 4 months ago

that is a great article, we surely can use information from that!

mahdikhashan commented 4 months ago

I have added user test scenarios to the drive folder under "UI/UX - Research / User Test Scenarios".

@darwiroba you may find them helpful while you are doing the user test session with target users.

mahdikhashan commented 4 months ago

not related to this issue,

I have added a document to the drive with the existing accessibility challenges which still exists, they do require further research and prototyping and user tests to be validated.

you may find this document in the shared google drive under "accessibility / accessibility issues".

cc: @kadhonn

darwiroba commented 3 months ago

Last Monday we did some User tests with 3 test participants and got some great insights. I've noted down everything in the Google Drive folder for UI/UX where you can look up the details. Further analysis and structuring of the findings will follow.

Additionally, another person will be participating in a testing session soon. A date still has to be found.

And some Update Social fellows agreed to participate as well. Now that I have a User test template that I think is sensible, I'll make a Google Forms survey and send it out.

darwiroba commented 3 months ago

I created a Google Forms survey that is basically a remote version of the qualitative User Test we did physically with the 3 former participants. The link is attached. This survey will be shared with USC fellows who volunteered to help us gather data on the Website.

https://docs.google.com/forms/d/e/1FAIpQLSeheieg4YgovgLqx3ERRtqIfZV95qk_S7h8G68-CogJyNvijA/viewform?usp=sf_link