UX Usability Tests

[JessicaMarine]

On September 17-19, 2019, the UX team conducted on-site usability tests with various user groups: Petitions, Docket, Calendar, Judges, IRS and Petitioners. https://docs.google.com/presentation/d/1dRmjUKiWYvdZAgxsXNvnXT_JGm8_H_PQey_u7oEIsVM/edit?usp=sharing

The output of those tests are captured here.

ACCEPTANCE CRITERIA: New MVP Recommendations:

• [x] 1) Add case status, sender to Judge’s messages inbox (MVP - New)- (Amy) (Matt #3228)
• [x] 2) Add Application for Waiver of Filing Fee as document included during case creation (MVP -New)- (Amy) (Matt #3232)
• [x] 3) Add “Batched By” information to the Petition QC Section Served tab (MVP - New) - (Amy) (Cody #3234)
• [x] 4) Update language and priority of the “Add Batch” action; options include updating language to “Start Scan” or “Add Document”, changing the style to a primary button, co-locating the action with the scan selector (MVP - New) - (Amy) (Cody #3234)
• [x] 6) Update language and consider changing visual treatment of the session detail toggle to clarify that this will open the official (complete) trial session case list (MVP - New) - (Kristen) (Cody #3235)
• [x] 7) Include printable receipt for all document filings, with unique identifier (MVP - New) - (Kristen) (Matt)
• [x] 8) Add helper text regarding typeahead to Document Type field (MVP - New) - (Kristen) (Cody #3243)
• [x] 10) Change the “Additional Info” fields on the Add Docket Form to text area fields to allow more visible characters (MVP- New) - No design (Rachael #3246)

BELOW NOT IN THIS STORY____

MVP - New Stories Needed

• Additional testing for filing a petition with pro-se petitioners (#3286)
• Update the list of trial statuses to include statuses that are meaningful and beneficial to judges prior to calendar call (#3287)
• Consider a redesign of the Case Detail page after core functionality is implemented (#3288)
• Add functionality for flatbed and two-sided scanning (MVP- New) - No design (#3290)
• Redesign message view on Document Detail screen to prioritize the selected message; allow access to other user messages as a secondary action (#3306)

MVP - Add to Existing Stories

• Consider wayfinding queues for workflows with deeper structures; considering breadcrumbs, in-app “Back” functionality, etc. (#1925)
• Add indicator for docket entries that are awaiting QC; these could be treated the same or similar to incomplete docket entries ( #991)
• Allow users to mark if a case has been reviewed and is ready to set for trial; show indicator cases that have been reviewed versus cases that are awaiting review (#1925)
• Allow users to remove cases that should not be set for trial from the eligible cases list; this could be automated based on case status (#1188, #1196)
• Allow visibility into when trial notices should/will be sent, and indicators for sessions that have been issued notices (#1193)

Post-MVP - New Stories (#3291)

• Add tooltip for icons (Post-MVP - New Story)
• Consider draft-state/in-progress state for petitions where QC has been updated (Post-MVP - New Story)
• Add ability to sort messages by read/unread (Post-MVP)
• Add direct “Reply” ability to messages (Post-MVP)
• Retain data in contact information fields when party type is changed (Post-MVP)
• Add a general summary screen with all petition information (and orders needed) prior to adding to batch (Post-MVP)
• Add details on what is included in the petition batch: other documents included with petition, number of pages within each document (Post-MVP)
• Update the scan review panel to show a scrollable list of thumbnails for scanned pages (Post-MVP)
• Add ability for user to enter the expected number of pages a scan should contain (to verify the scan is complete) (Post-MVP)
• Investigate need for multiple document scans and individual page deletion/replacement. While this was expressed as a concern by all users, their stated QC process does not indicate an actual need for these features. (Ongoing- Post-MVP)
• Consider adding the timeliness date (date the petition was due) along with the IRS Notice date (Post-MVP)
• Add additional sort and filter options for the docket record (Post-MVP)
• Add tooltip for icons (Post-MVP)
• Allow users to more easily navigate between documents on the docket record, without having to go back to the Case Detail and select another document (Post-MVP)
• Add known court addresses to database to support prepopulation of trial locations (Post-MVP)
• Provide easy access to court contact information for external users (Post-MVP)
• Add service information where relevant in the File a Document form; consider including it with the filing parties or COS (Post-MVP)
• Include additional instructions around supporting documents on File a Document form for external users (Post-MVP)

Post- MVP - Add to Existing Stories

• Include pending motions on Judge’s Dashboard (#2764)
• Allow users to customize the Working Copy by additional sort and filter options (#2767) *Allow judge users to select their note privacy preferences and opt in/opt out of sharing notes with other users (#338)
• Indicate on external dashboard if a case has deadlines and if case has been set for trial (#534)

Definition of Done (Updated 8-28-19)

Product Owner

• [x] Acceptance criteria have been met

UX

• [x] Business test scenarios to meet all acceptance criteria have been written
• [x] Usability has been validated
• [x] Wiki has been updated (if applicable)
• [x] Story has been tested on a mobile device (for external users only)

Engineering

• [x] Automated test scripts have been written
• [x] Field level and page level validation errors (front-end and server-side) integrated and functioning
  • [x] New screens have been added to pa11y scripts
  • [x] All new functionality verified to work with keyboard and macOS voiceover https://www.apple.com/voiceover/info/guide/_1124.html
  • [x] READMEs, other appropriate docs, JSDocs and swagger/APIs fully updated
  • [x] UI should be touch optimized and responsive for external only (functions on supported mobile devices and optimized for screen sizes as required)
  • [x] Module dependencies are up-to-date and are at the latest resolvable version (npm update)
  • [x] Errors in Sonarcloud are fixed https://sonarcloud.io/organizations/flexion-github/projects
  • [x] Lambdas include CloudWatch logging of users, inputs and outputs
  • [x] Code refactored for clarity and to remove any known technical debt
  • [x] Deployed to the dev environment
  • [x] Deployed to the stage environment

[alsmith1]

Item 1) Add case status, sender to Judge’s messages inbox

[alsmith1]

2) Add Application for Waiver of Filing Fee as document included during case creation

[alsmith1]

3) Add “Batched By” information to the Petition QC Section Served tab!

[alsmith1]

4) Update language and priority of the “Add Batch” action; options include updating language to “Start Scan” or “Add Document”, changing the style to a primary button, co-locating the action with the scan selector

[klohman]

AC- 6

Session Working Copy

• Update page title to include Judge's name - format is "[Judge Name] - Session Copy"
• Update link text to "View All Session Info"
• On click of "View All Session Info" - open standard Trial Session Detail screen

Trial Session Detail

• Update link text to "View Judge Session Copy"
• On click of "View Judge Session Copy" - open assigned Judge's Working Copy of session
• "View Judge Session Copy" is only visible to the assigned judge

AC - 7

• Applies to all external filings electronically submitted
• Upon submission of electronic filing, app navigates to Case Detail with success message displayed

Updated Success Message

• On click of "print a receipt" link, open Receipt PDF in new tab

Printable Receipt PDF

AC- 8

• Add helper text to "Document type" field (all instances)

[alsmith1]

Test scenarios

Scenario 1 - Case status, sender added to Judge’s messages inbox

1. log in as a Judge
2. On the Dashboard Recent Messages table confirm Case status and From have been added to the table after Document

Expected result

• [x] Case Status Column has been added to the table
• [x] From Column has been added to the table

Scenario 2 - Application for Waiver of Filing Fee as document included during case creation

1. Log in as a petitions clerk
2. Navigate to Document QC and click Create a Case
3. Locate and click on the Filling Fee Waver Tab
4. Upload a document in filing fee waver.

Expected result

• [x] New tab displays in case detail for Filing Fee Waver
• [x] A document can be scanned or uploaded in the Filing Fee Waver Tab

Scenario 3 - “Batched By” information added to the Petition QC Section Served tab

1. Log in as a petitions clerk
2. Navigate to Document QC
3. Click the served tab
4. Confirm Batched By has been added to the table between Document and Served

Expected result

• [x] Batched By Column has been added to the table

Scenario 4 - “Start Scan” button replaces Add Batch link and is located in top right of tab

1. Log in as a petitions clerk
2. Navigate to Document QC and click Create a Case
3. In the Petitions tab choose the scan radio button and locate the "start scan" button (it will be located at the top right of the tab

Expected result

• [x] Start Scan button is a primary button located to the right of " how do you want to add in this document" text

Scenario 5 - Update language and consider changing visual treatment of the session detail toggle to clarify that this will open the official (complete) trial session case list

1. Log in as a judge
2. Navigate to Trial Sessions and choose a trial session assigned to your user in the table below
3. Click on View All Session info link Expected results
   • [x] App navigates to Judges' Working Copy
   • [x] Page title displays as [Judge's Name] - Session Copy
   • [x] Link to "View all Session Information" displays

Scenario 6a - Update language and consider changing visual treatment of the session detail toggle to clarify that this will open the official (complete) trial session case list

1. On the session information page link next to the title should read: "View Judge Session Copy"
2. Click on "View Judge Session Copy" - opens assigned Judge's Working Copy of session "View Judge Session Copy" is only visible to the assigned judge

Expected result

• [x] Link next to the title reads "View Judge Session Copy"
• [x] link opens assigned Judge's Working Copy of session "View Judge Session Copy"

Scenario 6b - Update language and consider changing visual treatment of the session detail toggle to clarify that this will open the official (complete) trial session case list

1. Log in as a petitions clerk
2. Navigate to Trial Sessions

Expected result

• [x] Pages does not have link to "View Judge Session Copy

Scenario 7 - Printable receipt for all document filings, with unique identifier

1. Log in as a petitioner
2. Navigate to existing case and click the File a Document button
3. Fill out the form and submit the document(s)
4. Check the Case Detail page for a success message
5. Click on print a receipt link in success message (Applies to all external filings electronically submitted)

Expected result

• [x] Upon submission of electronic filing, app navigates to Case Detail with success message displayed
• [x] On click of "print a receipt" link, open Receipt PDF in new tab

Scenario 8 - Add helper text regarding typeahead to Document Type field

1. Log in as practitioner1
2. Click Docket Number: 101-19W
3. Click on File a Document button
4. On the What Document are you filing page helper texts displays above the Document type dropdown box.

Expected result

• [x] Helper message displays above the Document Type dropdown menu that reads: "Enter the document name to see available document types, or use the dropdown to select your document type."

Scenario 10 - Change the “Additional Info” fields on the Add Docket Form to text area fields to allow more visible characters

1. Log in as a docket clerk
2. Click on a docket number
3. Click on Add a Docket Entry
4. Verify the Additional Info fields display as text areas, multiple line input not the single line entries

Expected result

• [x] Additional Info fields display as text areas, multiple line input

[JessicaMarine]

10.15.19 PO Review:

• On the Petitions Clerk QC Box (both individual and section) -- there doesn't need to be a "Filed by" column on either; the "Case name" column is sufficient