department-of-veterans-affairs / va.gov-cms

Editor-centered management for Veteran-centered content.
https://prod.cms.va.gov
GNU General Public License v2.0
99 stars 69 forks source link

Analyze Medallia qualitative survey data for remaining PW portfolio products #12791

Closed wesrowe closed 7 months ago

wesrowe commented 1 year ago

Status: [2024-04-04] Carving off Resources & Support, and Search into their own tickets.

NOTE: should pull more recent data when we pick this up

Description

User story

AS A(N) member of the Public Websites team I WANT to understand current user feedback on the products in the Public Websites portfolio SO THAT we can consider if there are any that we should try to work

When writing ACs and estimating, check how many rows are present in remaining data.

Notes / Background

Qualitative Medallia export was already requested in this ticket, which was closed (executed) on 3/1/23. Cindy may have access to that export.

Acceptance criteria

Team

Please check the team(s) that will do this work.

cindymerrill commented 1 year ago

@wesrowe Wondering if this should be split into 2 tickets because it's so much data analysis. If so, maybe Resources and Support and Search could together become a different ticket?

cindymerrill commented 1 year ago

@wesrowe I'm leaving the "Needs Refining" label on this until I hear from you about whether you want this to be 2 tickets or only 1.

cindymerrill commented 1 year ago

Just received more Medallia data on Search from Ian McCullough, which he had to request from another team. So when I'm ready to analyze the Search data, I have more of it.

wesrowe commented 1 year ago

refinement: @thejordanwood will find out from @cindymerrill what the state of this ticket is when they're both back in the office around 7/13.

cindymerrill commented 1 year ago

I haven't worked on this ticket for a while because I've been assigned other research projects that have taken all of my time. The products listed above are the ones that I haven't done any data analysis on. Is this the status that @thejordanwood is looking for?

thejordanwood commented 1 year ago

@cindymerrill Thanks Cindy! Yes, that's what I was looking for. I'm going to start working on this again and wanted to make sure I wasn't going to duplicate efforts.

cindymerrill commented 1 year ago

What will you be doing, @thejordanwood ? Analyzing survey data, or something more design related?

jilladams commented 1 year ago

From S89 planning: If @thejordanwood and/or @cindymerrill have capacity, both should connect re: what happens next here before work picks up.

cindymerrill commented 1 year ago

Started working on this ticket.

Looked at feedback on Disability Rating Calculator, summarized the little qualitative data that was there in my Verbatims spreadsheet, and added it to the PW Portfolio spreadsheet.

cindymerrill commented 1 year ago

Looked at feedback on Find a Form, tagged the qualitative feedback, summarized in a pivot table, and added it to the PW Portfolio spreadsheet.

FYI @jilladams @wesrowe In the original data are my tags as well as YELLOW highlighting for specific form issues that could be shared with VBA/VHA form owners, which are also listed below:

Issue Form number/description
can't download form 21-526
can't find form 861
can't find form 2237
can't find form 3075
can't find form 7468
can't find form 0969 [can't replicate]
can't find form 10-1281
can't find form 1099R for my VA payments
can't find form 20-0344
can't find form 21-0960L-2
can't find form 21-0960P-3
can't find form 26-1880
can't find form DD149 filled out online
can't find form form to request a flag holder at cemetery
can't find form search didn't find Form 21-4142 [can't replicate]
can't find form travel pay
can't print form 13055
can't print form 21 p-4703
can't print form only 3/4 of it prints
can't tab through fields on form [tab order wrong] 526EZ
form outdated 10-5345 and 10-5345a are both dated July 2021
form outdated 21-22 says Feb 2019 and has expiration date of 2/28/2022
form outdated most recent version of 26-6393 [can't replicate]
leading zeroes not allowed, so can't enter SSN that starts with a zero 966 [couldn't replicate but maybe investigate more]
link not working apply for Veteran ID card
link not working disability compensation

cindymerrill commented 1 year ago

Started working on analyzing Benefit hub data.

cindymerrill commented 1 year ago

Have pulled out all relevant verbatims from ALL of the Benefit Hubs data into a new spreadsheet tab. Still need to review tags and summarize.

cindymerrill commented 1 year ago

Summary of Find a Form verbatims, which I put into the PW Portfolio spreadsheet:

cindymerrill commented 1 year ago

High-level summary of Benefit hubs verbatims, which I put into the PW Portfolio spreadsheet:

Could do additional analysis (if desired) on the specific tasks that people were trying to do but couldn't, and also of the information they were unable to find.

cindymerrill commented 10 months ago

@FranECross Perhaps this ticket should be moved back into Refined because I won't have time to get back to it for a while

FranECross commented 10 months ago

@cindymerrill Excellent idea. I'll scoot it back there. Thanks!

aklausmeier commented 9 months ago

@FranECross - @cindymerrill and I discussed this work as a potential next up, we may need to adjust and refine AC's but we can refine when this is ready to pull in

FranECross commented 9 months ago

Thank you, @aklausmeier !

FranECross commented 7 months ago

@aklausmeier I carved off the remaining features, Resources & Support, and Search, into their own tickets and am going to close this one. cc @thejordanwood @jilladams

The new tickets are:

FranECross commented 7 months ago

Closing per comment above.