search

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
281 stars 197 forks source link

[CAIA A11y Research]: Ask VA VA.gov Team, Ask VA – Dashboard (September 2024) #92003

Open tygindraux opened 1 week ago

tygindraux commented 1 week ago

[!NOTE] High-Level Overview: ASK VA

  • Research Timeframe: September 17 - 24 2 Slots Remain as of 9/13/2024 at 9:30 a.m. EST
  • Pilot 1: Mobile with Screen Reader: #92024
  • Pilot 2: Desktop with Alternative Nav.: #92028
  • Assistive Tech Users: 12 AT Users
    • 3 cohorts with a min. of: 3 screen reader; 2 alt. nav.; and 1 screen mag.
  • Artifacts Available: Research Plan
  • Testing Environment & Schedule: Staging & Source of Truth (also see table in this ticket)
  • Assistive Tech Being Used: Screen Readers, Alternative Navigation and Screen Magnification.
  • CAIA Internal Doc: CAIA Raw Session Notes: Google Doc
  • Task Lists: See task lists for next steps/definition of done

CAIA Assignee(s)

Toggle to view information about the CAIA Team. `TBD` - Pilot 1 (Mobile): SK and Evan - Pilot 2 (Desktop): Jamie, Sara and Evan - Research Session Support - Evan - Sara - Maria - Jamie

About the Team

Toggle to view more intake research ticket information ### Do you have an accessibility champion? No, we don't have a champion (yet) ### If you have an accessibility champion, what's their name? _No response_ ### Is anyone on your team interested in becoming an accessibility champion? _No response_ ### Calendar checking - [X] Based on this calendar, confirm we have specialists who can support your study in your desired timeframe - [X] Confirm you are filing this support ticket at least 1 week in advance of said timeframe, so we have enough heads up to provide support ### Have you reviewed the CAIA capacity calendar? - [X] Yes, we have reviewed the CAIA capacity calendar and can confirm specialists are available to support in our research timeframe

Research Sessions

[!TIP]

  • Providing CAIA A11ys with the time slots in advance for AT users, will allow a11ys to avoid conflicts on the CAIA A11y Capacity Calendar, and reach out to other a11ys, should CAIA not be available.
  • Providing CAIA A11ys with the technology and devices the users will be testing with, will allow CAIA to prepare in advance for the sessions.
Toggle to view research timing information. ### Timeframe 1. **Pilot Session Mobile Screen Reader**: `TBD` Around 9/6/2024 2. **Pilot Session Desktop Alt. Nav.**:`TBD` Around 9/6/2024 **Timeframe**: - September 17 - 24, 2024 ### Length of sessions - **Session length:** - 90 minutes (screen reader or alternative navigation tool) - 60 minutes (screen magnification tool) - **Buffer time between sessions:** 30 minutes - **Maximum sessions per day:** 2

Testing Schedule

CAIA A11Ys will be looking for device and AT information. We realize that some of this information will not be available until the day of the session.

Please toggle and use the following table to enter the following information for each participant: Date and Time, Assistive tech (AT), Device and Operating System, Browser, and Skill level:

Source of Truth

Testing Schedule - Google Sheet also see table in this ticket

Toggle to view the AT testing schedule _Participant numbers changed on 9/12/2024. Changes and additional switches noted in bold for the participant column below, as of 9/13/2024 9:21 a.m. EST._ P# | Date and Time (EST) | AT | Device and OS | Browser | Skill | CAIA A11ys Available ------------------|------------------|--------------|--------------|--------------|--------------|-------------- **PILOT MOBILE `92024`** | 9/11/2024 2-3 p.m. ET| VoiceOver, JAWS, etc `TBD` | Mobile, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Pilot | @SarahKay8 **PILOT DESKTOP `92028`** | 9/11/2024 11 a.m. | Voice Command | Desktop | Chrome | Pilot | @coforma-jamie P1 | Tues. Sept. 17 9 a.m. | VoiceOver | **Mobile**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Novice | @sara-amanda P2 | Tues. Sept. 17 11 a.m. | VoiceOver | **Mobile**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | @EvanAtCoforma P3 | Wed. Sept. 18 1 p.m. | VoiceOver (also uses Fusion) | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | @mutiaadhocteam P4 | Wed. Sept. 18 3 p.m. | VoiceOver | **Desktop**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | @EvanAtCoforma P5 |Thurs. Sept. 19 1 p.m. | VoiceOver | **Mobile**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | @EvanAtCoforma **P6** | Thurs. Sept. 19 3 p.m. | VoiceOver | **Mobile**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | @coforma-jamie P7 | Fri. Sept. 20 9 a.m. | Dragon | **Desktop**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | @sara-amanda P8 | Fri. Sept. 20 11 a.m. | Dragon | **Desktop**; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | @sara-amanda **P9** | Mon. Sept. 23 12 p.m. | Voice Control | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | @sara-amanda **P10** | Mon. Sept. 23 3 p.m. | **Screen Magnification** - Enlarge screen on Safari using gestures | **Mobile** - Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | @SarahKay8 **P11** | Tues. Sept. 24 9 a.m. | **Screen Magnification** - Windows 11 | **Desktop**; Windows | Chrome, etc. `TBD` | Advanced | @SarahKay8 **P12** | Mon. Sept. 23 10:30 a.m. | Text to talk Microsoft dictation | **Mobile**; - Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | **a11y TBD** - **Consideration**: You can also consider asking participants more specific AT and device combinations. - **For instance:** TalkBack on Samsung Galaxy 8, or VoiceOver on iPad with magnification.

CAIA A11ys will review the coverage needed, and self-assign, based on a11y availability.

Supporting artifacts

Toggle to view the supporting artifacts - [Product outline](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/ask-va/products/ask-va-phase-1-product-outline.md) - [User flows](https://app.mural.co/t/departmentofveteransaffairs9999/m/departmentofveteransaffairs9999/1708479170047/8ebb517a213e05ebc500087f5661a993a41392e8?wid=1358-1710439493448) - [Prototype or mockups](https://staging.va.gov/contact-us/ask-va-too/introduction) – Click 'Research study' sign in button - [Research plan](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/ask-va/design/User%20research/07-2024%20Assistive%20tech/Dashboard/Research%20plan.md) - [Research conversation guide](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/ask-va/design/User%20research/07-2024%20Assistive%20tech/Dashboard/Conversation%20guide.md) - [Epics/issue that may be helpful](https://github.com/department-of-veterans-affairs/va.gov-team/issues/87480) – Previous study we worked on with y'all! - [How to create a new test user account](https://app.zenhub.com/workspaces/ask-va-647a476551689d06655cc815/issues/gh/department-of-veterans-affairs/ask-va/1218) - [List of test user accounts created for this study](https://github.com/department-of-veterans-affairs/va.gov-team-sensitive/blob/master/products/ask-va/test-user-accounts.md)

Next Steps: Definition of Done

### CAIA A11Y Tasks
- [x] **INTAKE TICKET:** @sara-amanda to process intake ticket
- [x] **PILOT CALENDAR HOLDS** - Set **pilot** holds on the A11y [**CAIA Capacity Calendar**](https://calendar.google.com/calendar/u/0/embed?src=c_f982350fc73a8162a1088ab14d00dd37335b2b559a60d6b67eb8021416f81c2a@group.calendar.google.com&ctz=America/Chicago)
- [x] **PILOT SESSION MOBILE: SCHEDULE** Pilot session with team. `Conduct around 9/6/2024` `a11y TBD`
- [x] **PILOT SESSION DESKTOP: SCHEDULE** Pilot session with team. `Conduct around 9/6/2024` `a11y TBD`
- [x] **PILOT SESSION MOBILE: CREATE TICKET** See `related tickets task list` in this ticket.
- [x] **PILOT SESSION DESKTOP: CREATE TICKET** See `related tickets task list` in this ticket.
- [x] **CALENDAR HOLDS** Update A11y [CAIA Capacity Calendar](https://calendar.google.com/calendar/u/0/embed?src=c_f982350fc73a8162a1088ab14d00dd37335b2b559a60d6b67eb8021416f81c2a@group.calendar.google.com&ctz=America/Chicago) with holds for user research sessions with AT, when dates become available.
- [x] Receive Source of Truth for Scheduling [Google Sheet](https://docs.google.com/document/d/1vuk0sTW6YV-4mnWf-an5DLlj0tgSD9nnuGa1Y8puVOM/edit?usp=sharing)
- [x] **Requested device breakdown:** Desktop, Mobile and Tablet
- [x] **Divvy user research session support with CAIA A11ys** - based on availability and technology available to support.
- [x] **Updated Holds** Holds updated to specific slots for P1 - P12 on xx/xx/2024 - waiting on official invites (table updated in this ticket as well, based on Roster tab)
- [x] **REMOVE CALENDAR HOLDS** Remove holds on A11y [**CAIA Capacity Calendar**](https://calendar.google.com/calendar/u/0/embed?src=c_f982350fc73a8162a1088ab14d00dd37335b2b559a60d6b67eb8021416f81c2a@group.calendar.google.com&ctz=America/Chicago) and replace with invitations from project team (or Perigean) Updated holds x/xx/2024
- [x] **P# Shifts:** Updates to the participant numbers cross-referenced with sign-ups and switches between CAIA team members is now complete. 2 slots remain as of 9/13/2024 at 9:24 a.m. EST.
- [ ] **Review research folder and assets** `Ready by 9/6/2024`
- [x] **OFFICIAL RAW RESEARCH NOTES** Create [CAIA notes document](https://docs.google.com/document/d/1vuk0sTW6YV-4mnWf-an5DLlj0tgSD9nnuGa1Y8puVOM/edit?usp=sharing)
- [ ] **Participate in research**  **Date Span:**`9/17/2024` and `9/24/2024`
- [ ] **SYNC:** Connect with CAIA A11ys on research findings (meeting)
- [ ] **Create/update the CAIA A11y Research Deliverable** This is dependent on the number of study participants CAIA supports. If minimal, A11Ys may share feedback only in the feedback Mural or this ticket.
- [ ] **Share the completed deliverable** with the project team via Slack: `Primary Team Slack` and `Ticket`
- [x] **TEMPLATE SESSION NOTES**: Create [CAIA notes document]for a11ys to use during the sessions
### VFS TEAM Tasks
- [x] Tag @Naomi Eke in Slack [#sitewide-content-accessibility-ia](https://dsva.slack.com/archives/C01K37HRUAH)
- [x] Your team's researchers and observers read through platform guidance on research with assistive technology users
- [x] Review our [assistive technology pilot guide](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/teams/CAIA/accessibility/assistive-tech-pilot-guide.md) and request a pilot, if desired
- [x] Request pilot sessions with CAIA a11ys x2
- [x] Schedule pilot session with CAIA a11ys (Mobile)
- [x] Schedule pilot session with CAIA a11ys (Desktop)
- [x] **PROTOTYPE:** Provide prototype to CAIA A11ys via this ticket in the supporting artifacts section `Available on Sept. 3, 2024 via Staging Link`
- [x] **DATES NEEDED** See `Table` in the ticket above. Please provide date range and slots for AT sessions being planned.
- [x] **ASSISTIVE TECH. INFO NEEDED:** Please provide the AT the users will be utilizing during the research sessions in `Table` in the ticket above.
- [x] **INVITES:** Forward invites from Perigean to CAIA A11ys (Sara)
- [x] **Device Detail:** Desktop, Mobile and Tablet - Device breakdown needed for session prep
- [x] Participant numbers adjusted with Perigean (CAIA to make updates to calendar, table and tracking)
### Related Tickets
- [ ] https://github.com/department-of-veterans-affairs/va.gov-team/issues/92024
- [ ] https://github.com/department-of-veterans-affairs/va.gov-team/issues/92028
tygindraux commented 1 week ago

Hello! I posted this issue on Slack today.

We're hoping to get accessibility support for this study, which will be very similar to our last study.

We'd like to run 1-2 pilots with CAIA over the next week. I've added more detail about this in our research plan.

Let me know if there are other questions.

tygindraux commented 1 week ago

@sara-amanda – I noticed there are pilot tickets created.

Here are some times that work for us:

Let me know if any of these work for you all 😊

sara-amanda commented 1 week ago

Ask VA Availability

@sara-amanda – I noticed there are pilot tickets created.

Here are some times that work for us:

  • Monday, September 9 between 11am - 4pm EST
  • Tuesday, September 10 between 11am - 4pm EST
  • Wednesday, September 11 between 11am - 4pm EST

Let me know if any of these work for you all 😊

Scheduled Pilots

tygindraux commented 4 days ago

@sara-amanda – I added you to the study channel, let me know if I should add everyone in CAIA.

Here is the research schedule and it's ready CAIA folks to sign up to support sessions. This is the same format as last time. If you navigate to tab 3, called 'Schedule,' you'll find the sessions. There is a column for an A11y specialist to sign up to each session.

Let me know if you can share with CAIA. Also, I'll create research invites in the calendar tomorrow or Friday which I'll forward to you to add to your capacity calendar.

sara-amanda commented 3 days ago

Research Schedule: Ask VA

Thank you so much @tygindraux ! 🙌

Completed

Next Steps

cc: @NaomiPMC @SarahKay8 @coforma-jamie @EvanAtCoforma @mutiaadhocteam @rileyorr

Updated 9/13/2024

tygindraux commented 2 days ago

We don't necessarily need coverage on the screen magnification sessions but SK is welcome to join.

I've updated the invites today based on your changes to the schedule. If there are any issues let me know.

SarahKay8 commented 2 days ago

image

Hey @tygindraux! This is a more in depth feedback summary (options/alternatives) of the accordion page i had concerns about. Could you please pass this to your designers? Thanks in advance 🦋

Hierarchy and Content Layout

It seems that the hierarchy of the information could be improved. The question and response should take priority over the time, as they are the most relevant pieces of information. For better scannability, it would be more effective to bold the question and response, placing the time as a secondary line beneath them. Users are generally searching for the content of the interaction, not the timestamp.

Email Thread Interaction

Considering how Gmail handles threads, all messages are automatically expanded, with the option to collapse them. Similarly, it might be more intuitive to have all messages initially expanded. This would also enhance searchability, allowing users to search for keywords within the content.

Accordion Searchability

When the accordions are collapsed, it prevents users from searching the content inside them. If the accordions were expanded by default, it would make keyword search more user-friendly

Message Order and Interface Clarity

Switching the message order to display the latest message at the top could improve the interface's cleanliness. Expanding only the latest message while keeping previous ones collapsed would create more space and a better look

Reply Box Placement

Would it make more sense to place the reply box immediately after the latest message, or even at the top? Maybe including a button to focus directly on the reply box could improve navigation

Cc: @coforma-jamie @EvanAtCoforma

tygindraux commented 2 days ago

Thanks SK! I wrote up some initial replies to these, but looking forward to seeing what we find during research with Veterans, too.

I really appreciate you taking the time to write feedback ❤️ I'll share with my team so we can keep this in mind during sessions and see what comes up for Veterans.

SarahKay8 commented 2 days ago

Wonderful - thanks so much for clarifying! Happy to help always! @tygindraux