search

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
281 stars 196 forks source link

[CAIA A11y Research]: Disability Benefits: Contention Classification Team - New Conditions Page: Form: 21-526EZ (EOM July-Aug 2024) #76707

Open sara-amanda opened 5 months ago

sara-amanda commented 5 months ago

[!NOTE] High-Level Overview: Contention Classification Team

CAIA Assignee(s)

About the Contention Classification Team

Toggle to reveal team information - **Team name:** Contention Classification - **OCTO product owner:** Jen Bertsch - **Product name:** 526EZ - **Product manager:** Yurena Garcia - **Slack channel:** [benefits-contention-classification](https://join.slack.com/share/enQtNjYwMDExOTQyMDc1Ny1iOGNlYTE4ZjY4OGM2YmUzOWE3YmY3MTMwMzA4MzRkMzQyNWVjMzE3NDQ0ODk4NDMzYmJhNjNmNGRiN2FjM2Vj) - **Dedicated content writer on your team (if you have one):** N/A - **Dedicated a11y specialist on your team (if you have one):** N/A

Background Info

We are updating the "add new conditions" page on the 526EZ Form. We started with updating the conditions themselves, the list that the autosuggestion component (dropdown) uses. Now, we are focused on UI and copy changes.

Toggle to view additional background information about this project. > Our goal with the new conditions page is to improve user experience and accuracy when entering medical conditions for disability benefits. We aim to simplify the process by creating a user-friendly interface that enables Veterans to select or input their conditions effortlessly. Specifically, we aim to ensure that users understand how the autosuggest component functions, what information they need to provide, and that it supports free-text entries.
Toggle to reveal additional team information from the research intake ticket ### Do you have an accessibility champion? No, we don't have a champion (yet) ### If you have an accessibility champion, what's their name? _No response_ ### Is anyone on your team interested in becoming an accessibility champion? _No response_ ### Calendar checking - [X] Based on this calendar, confirm we have specialists who can support your study in your desired timeframe - [X] Confirm you are filing this support ticket at least 1 week in advance of said timeframe, so we have enough heads up to provide support ### Have you reviewed the CAIA capacity calendar? - [X] Yes, we have reviewed the CAIA capacity calendar and can confirm specialists are available to support in our research timeframe ### When is the timeframe for your testing? CodePen Prototype should be ready for testing by March 13, 2024, per intake ticket and kickoff meeting conversations on 2/21/2024 [See update re: timeframe comment in Pilot Ticket as of 6/25/2024](https://github.com/department-of-veterans-affairs/va.gov-team/issues/76779#issuecomment-2173729058)

Research Sessions

[!TIP]

  • Providing CAIA A11ys with the time slots in advance for AT users, will allow a11ys to avoid conflicts on the CAIA A11y Capacity Calendar, and reach out to other a11ys, should CAIA not be available.
  • Providing CAIA A11ys with the technology and devices the users will be testing with, will allow CAIA to prepare in advance for the sessions.
  • We also recommend running a pilot session with CAIA a11ys, prior to your assistive technology research sessions, to mitigate any issues that may occur, in advance.
Toggle to view research timing information. ### Timeframe - **Pilot Session**: `COMPLETED 7/22/2024` [76779](https://github.com/department-of-veterans-affairs/va.gov-team/issues/76779) - prior to the start of testing on ~4/10/2024~. ~4/4/2024~ Now end of May 2024. - **Timeframe**: ~4/10/2024 - 4/23/2024 4/4/2024 - 4/12/2024~ - May not be able to completed due to limited CAIA Availability w/o 7/15 testing week of 7/22. - However, two audits have been done by CAIA A11Ys. - The week #### REVISED TIMEFRAME - June 10: - ~Launch (during sprint 33 June 5 - 18)~ - June 19-July 2: - ~They will be preparing for AT user testing (during sprint 34)~ - ~Assuming we can do the pilot in here, so I flagged it for 6/19 on the tracker (for now).~ - July 3 - July 17: - ~(during sprint 35) there appears to be recruitment for user testing at the end of that sprint (based on the Mural).~ - ~So, I put testing on the research calendar as holds for then.)~ ##### Adjusted Timeframe - As of 7/10/2024 [Testing will take place 7/24-8/1/2024 with 8 users](https://github.com/department-of-veterans-affairs/va.gov-team/issues/76707#issuecomment-2221700984) - As of 7/3/2024 Testing to take place [week of: 7/22/2024](https://github.com/department-of-veterans-affairs/va.gov-team/issues/76779#issuecomment-2207135062) - As of 6/25/2024 Testing to take place in "early July." July 22, 2024 [View Comment in Pilot Ticket](https://github.com/department-of-veterans-affairs/va.gov-team/issues/76779#issuecomment-2173729058) ### Length of sessions - Length of Sessions: 45 minutes for screen magnification (cohort 1) and 90 minutes for screen reader (cohort 2). - Buffer time between sessions: 30 minutes - Maximum Sessions per day: 3 #### Session Windows **As of 7/10/2024 in the revised Research Plan:** **Roughly: (10 a.m.-5 p.m.ET)** - July 24th: 7:30AM PST - 2:00PM PST - July 25th: 9-10 AM PST, 11am-2pm PST - July 29th: 7:30 AM PST - 2:00PM PST - July 30th: 7:30 AM - 10:30 PST , 12:00 - 2:00PM PST - July 31st: 7:30 AM - 10:00 AM PST, 11AM - 2:00PM PST - August 1st: 7:30 AM - 2:00 PM PST

Testing Schedule

[!CAUTION]

LIMITED CAPACITY 7/5-7/17

There will be limited CAIA A11Y capacity 7/5-7/12, with 50% (2) of CAIA A11Ys OOO. There will be 75% (3) CAIA A11Ys available 7/12-7/17.

Dates with No Conflicts

There is currently no coverage conflict for 7/22. The week of 7/29/2024 there appears to be no conflicts as of 7/10/2024.

Scheduling Source of Truth

📆 Refer to the Disability Benefits Team's Google Sheet for the scheduling source of truth.

Toggle to view the AT testing schedule P# | Date and Time (ET) | AT | Device and OS | Browser | Skill | CAIA A11ys Available | Status ------------------|------------------|--------------|--------------|--------------|--------------|--------------|-------------- Pilot | July 22, 2024 4 p.m. | JAWS | Desktop; Windows | Edge | Advanced | Jamie and Sara | `COMPLETED` P1 | 7/24/24, 10:30-11:30 am | Windows Magnifier | Desktop; Windows | Firefox | Advanced | Jamie | `COMPLETED` ✅ P2 | 7/24/24, 12:30-1:30 pm | ZoomText | Desktop; Windows | Safari, Chrome, etc. `TBD` | Novice, Intermediate, Advanced `TBD` | @sara-amanda | `NO SHOW` ❌ P3 | 7/25/24, 10:30-11:30 am | ~~ZoomText~~ none | Desktop; Windows | Safari, Chrome, etc. `TBD` | Novice, Intermediate, Advanced `TBD` | Jamie | `NO AT` ❌ P4 | 7/25/24, 12:30-1:30 pm | TalkBack | Mobile; Android | Chrome | Advanced | Evan | `COMPLETED` ✅ P5 | 7/25/24, 3:00-4:00 pm | VoiceOver | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | Evan | `COMPLETED` ✅ P6 | 7/29/24, 10:30 am - noon | VoiceOver | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | Jamie | `SCHEDULED` P7 | 7/29/24, 2:00-3:30 pm | VoiceOver | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Intermediate | Evan | `SCHEDULED` P8 | 7/30/24, 10:30-11:15 am | Screen Magnification | Desktop; MacOS| Safari, Chrome, etc. `TBD` | Novice, Intermediate, Advanced `TBD` | Jamie | `SCHEDULED` P9 | ~7/31/24~ 7/30, ~10:30-noon~ 3-4 p.m. | VoiceOver | Mobile or Desktop; Windows, MacOS, iOS, Android, etc. `TBD` | Safari, Chrome, etc. `TBD` | Advanced | Sara | `SCHEDULED` P10 | 7/31/24, ~12:30- 2pm~ 10:30-noon | JAWS | Desktop; Windows | Safari, Chrome, etc. `TBD` | Intermediate | Jamie | `SCHEDULED` P11 | 7/31/24, 12:30 - 2 p.m. | VoiceOver | Mac (Mobile?) | Safari, Chrome, etc. `TBD` | `TBD` | Jamie | `SCHEDULED` - **Consideration**: You can also consider asking participants more specific AT and device combinations. - **For instance:** TalkBack on Samsung Galaxy 8, or VoiceOver on iPad with magnification.

CAIA A11ys will review the coverage needed, and self-assign, based on a11y availability.

Supporting artifacts

Received Artifacts

There are two variations: "removing additional information" and "Adding additional information to component". We can test variations of both options or consolidate to one if there's a strong opinion.

Pending Artifacts

Toggle to reveal supporting artifacts that are not yet available ### Additional Items - [Product outline](Insert URL here between the parenthesis) - [User flows](Insert URL here between the parenthesis) - [Research conversation guide - RCVD 7/10/2024](https://github.com/department-of-veterans-affairs/va.gov-team/blob/master/products/disability/526ez/research/CC-Team-Research/202403%20Improved%20Autosuggest/conversationguide-assistivetech.md) - [Research Plan](https://github.com/department-of-veterans-affairs/vagov-claim-classification/blob/main/collab-cycle/%5Bimproved%20autosuggest%20component%5D/research-plan.md) - added 7/10/2024 - [Epics/issue that may be helpful](Insert URL here between the parenthesis)

Next steps

### Contention Classification Team Tasks
- [x] **SCHEDULE**: Initial meeting/Kickoff Held: 2/21/2024
- [x] **PILOT**: Schedule a pilot session with CAIA a11ys prior to research sessions (**recommended**) - 2 audits completed instead (w/o 7/15 has conflicts) - PILOT scheduled for Monday, 7/22. `COMPLETED`
- [x] **CONVO GUIDE**: Provide Conversation Guide for review by CAIA a11ys (**optional**) `7/10/2024`
- [x] **RESEARCH PLAN** Provide Research Plan in supporting artifacts section of this ticket. `7/10/2024`
- [x] **CODEPEN PROTOTYPE:** Provide prototype in CodePen to CAIA A11ys via this ticket in the supporting artifacts section for review prior to research #76766
- [x] **Staging Prototype** for new audit
- [x] **DATES NEEDED** See the table in the ticket above. Please provide date range and slots for AT sessions being planned. 7/22 range given on 7/3/2024. **UPDATE as of 7/10/2024**: Research will be 7/24-8/1/2024.
- [x] **INVITES:** Forward invites from Perigean to CAIA A11ys (Sara or Naomi)
- [x] **ASSISTIVE TECH. INFO NEEDED:** Please provide the AT the users will be utilizing during the research sessions in the table in the ticket above. `Screen Magnification` and `Screen Readers (Type Needed)` [Google Sheet Sign Ups](https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0)
### A11Y Tasks
- [x] **RESEARCH INTAKE TICKET** processed 2/21/2024
- [x] **MEETING:** Initial meeting/Kickoff Held: 2/21/2024
- [x] **HOLD** Broad calendar hold for 3/13 - 3/23 for research
- [x] **RECEIVE PROTOTYPE** `After 3/13/2024` RCVD 3/22/2024
- [ ] https://github.com/department-of-veterans-affairs/va.gov-team/issues/76766
- [ ] https://github.com/department-of-veterans-affairs/va.gov-team/issues/83767
- [x] Audit Staging Prototype @coforma-jamie (July 2024)
- [x] **REVIEW** Conversation Guide, if provided and requested (**optional**) - `Pending info. from Team`
- [x] **PILOT SESSION(S) SCHEDULE** Pilot session(s) `COMPLETED - 7/22/2024` with CAIA A11YS - 2 audits done
- [ ] https://github.com/department-of-veterans-affairs/va.gov-team/issues/76779
- [x] **MULTIPLE STUDIES** - Noted in ticket that the Week of 4/8 has multiple studies.
- [x] Ticket updates to reflect change in timeline 4/11/2024 (ss)
- [x] **CALENDAR HOLDS** Update A11y [CAIA Capacity Calendar with holds for user research sessions with AT, when dates become available.`BROAD HOLD AS OF 2/21/2024` Holds adjusted on 3/27/2024 with new dates. `Holds Removed on 3/29/2024` ~Study now running in May~ Holds updated 5/22/2024 study will be post-launch (June 10), and will likely take place in July. (Updated on 6/26/2024) (Updated on 7/10/2024) - UPDATED 7/15/2024 with 7/22-8/1/2024.
- [x] **REMOVE CALENDAR HOLDS*
- [x] **RESEARCH NOTES** Create [CAIA notes document](https://docs.google.com/document/d/1ax0pQP8agGunVEGHd5zDMFrraRXkw_evEKjRf-rx-ho/edit) - CAIA A11Ys to update the CAIA notes document during the sessions.
- [x] **DIVVY SUPPORT** for user research session support with CAIA A11ys - based on availability and technology available to support (Table to be added to this ticket, above, with AT session dates and times, so that available a11ys can sign up.)
- [x] **REVIEW** Research Folder and Assets `Pending info. from Team` - research plan added to supporting artifacts by Sara on 7/10/2024.
- [ ] **PARTICIPATE IN RESEARCH** **Date Span:**`7/24/2024` and `8/1/2024` `RCVD invites from Perigean`
- [ ] **SYNC:** Connect with CAIA A11ys on research findings (meeting)
- [ ] **Create/update the CAIA A11y Research Deliverable** This is dependent on the number of study participants CAIA supports. If minimal, A11Ys may share feedback only in the feedback Mural or this ticket.
- [ ] **Share the completed deliverable** with the project team via Slack: **Primary Team Slack:** [benefits-contention-classification](https://join.slack.com/share/enQtNjYwMDExOTQyMDc1Ny1iOGNlYTE4ZjY4OGM2YmUzOWE3YmY3MTMwMzA4MzRkMzQyNWVjMzE3NDQ0ODk4NDMzYmJhNjNmNGRiN2FjM2Vj) and this ticket
- [x] Research tracker updated to reflect new sessions scheduled, in lieu of cancled sessions (calendar validated; table in ticket updated) - 7/26/2024
sara-amanda commented 5 months ago

@sudeeptibh @coforma-terry @strelichl

Please find this research ticket, as promised.

Let us know if you have any questions.

coforma-jamie commented 4 months ago

Update

cc @sara-amanda @sudeeptibh

sara-amanda commented 4 months ago

Research Study Dates

Multiple Studies

cc: @coforma-jamie @coforma-terry @sudeeptibh

sudeeptibh commented 4 months ago

added research plan to the supporting artifacts section, thanks!

sudeeptibh commented 4 months ago

Just added the prototype for testing, thank you! Our timeline is looking like testing will between April 4th - 12th. We know you have limited capacity during that time and will keep that in mind. We cannot move to April 15th week due to teammates OOO.

coforma-jamie commented 4 months ago

Based on your team's usability testing changes as outlined on Slack, your AT research testing timeline is likely going to be after the week of April 15, is that correct? Keep us posted @sudeeptibh :)

sudeeptibh commented 4 months ago

@coforma-jamie just got stakeholder approval on the new plan - Our AT testing will definitely be after April 15th; currently, on the roadmap, it looks like it will be towards the end of May. We'll follow up once we have a better sense of the timeline. Thank you!

coforma-jamie commented 4 months ago

Gotcha! For now, I'm removing our calendar holds these sessions, until we have a better sense of the timeline, @sara-amanda :)

coforma-terry commented 4 months ago

Thank you for the heads-up @sudeeptibh

sara-amanda commented 3 months ago

Timeline Shift

Research changing to end of May 2024.

sara-amanda commented 2 months ago

Timeline Shift

Research changing to July 2024, after launch. Launch likely around 6/10, per Mural.

cc: @NaomiPMC

sara-amanda commented 2 weeks ago

CAIA Support Update

[!NOTE]

Pilot

Previous Audits Completed

Number of Sessions

At least 2 but no more than 3 Veterans who use assistive technology (AT) such as screen readers (AT/reader) or magnifiers (AT/magnifier)

Capacity Update

We are currently experiencing limited capacity; however, your testing the week of 7/22, does not appear to have any conflict at this time for any current scheduled testing or PTO.

cc: @coforma-jamie @EvanAtCoforma @SarahKay8 @NaomiPMC @artsymartha68

sudeeptibh commented 2 weeks ago
sudeeptibh commented 2 weeks ago

Tagging my co-workers @eheintzelman and @yurenanava for coverage on this while I'm OOO July 15 - 19.

sara-amanda commented 2 weeks ago

Thank you @sudeeptibh !

Yes, that timeframe works for us. The week of 7/29 is the most clear on our calendar, but as of right now, we only have holds for the previous week on your dates. I will get our calendar, ticket and research tracker updated to reflect your dates.

cc: @eheintzelman @yurenanava @NaomiPMC @coforma-jamie

eheintzelman commented 1 week ago

@sara-amanda Perigean has scheduled 7 of 8 interviews. I don't have the full information on type of tech for each of them yet, but am going to go ahead and send you those invites. Here is our in progress sign-up sheet.

eheintzelman commented 1 week ago

I updated the sign-up sheet for type of tech. Recruitment for 1 participant is still pending.

sara-amanda commented 1 week ago

Pilot Completed

cc: @NaomiPMC @coforma-jamie @yurenanava @sudeeptibh

sudeeptibh commented 1 week ago

Recruitment is done, there's two open slots for CAIA folks. Thanks y'all! https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0

sara-amanda commented 6 days ago

Recruitment is done, there's two open slots for CAIA folks. Thanks y'all! https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0

Can you forward me the new invite @sudeeptibh - that looks like the only one I am missing. Thanks so much!

sara-amanda commented 6 days ago

Recruitment is done, there's two open slots for CAIA folks. Thanks y'all! https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0

Can you forward me the new invite @sudeeptibh - that looks like the only one I am missing. Thanks so much!

@sudeeptibh We are all set for your sessions, as of right now, except one at the moment. The spreadsheet and this ticket has been updated. Thanks!

sudeeptibh commented 4 days ago

We are continuing to re-recuit as we've had no-shows or not qualified participants. Just added two more slots next week to the roster. https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0

sara-amanda commented 2 days ago

We are continuing to re-recuit as we've had no-shows or not qualified participants. Just added two more slots next week to the roster. https://docs.google.com/spreadsheets/d/1nrqw-iekbkWM2oDwBPvaFqo76tOHZJNn55RTJQviixQ/edit?gid=0#gid=0

@sudeeptibh we are all set to cover your sessions. All sessions now have an accessibility specialist. I hope you have better luck with the rescheduled sessions. The spreadsheet and this ticket has been updated. Thanks!