department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
281 stars 197 forks source link

Improve Medallia Intercept Survey data collection #88712

Open evelynhilbrichdavis opened 1 month ago

evelynhilbrichdavis commented 1 month ago

Issue Description

This ticket is scoped to dial in the Medallia Intercept survey so the quantitative and qualitative data collected helps DBEX to establish a baseline for measuring improvement. These changes will also focus on improving the Veteran experience of responding to surveys, optimizing for accessibility and limiting disruption.

Context

The 526ez features two Medallia surveys that collect Veteran feedback during the filing experience: Feedback and Intercept. The Medallia Intercept survey is enabled across all of modernized VA.gov. It randomly “intercepts” 5% of VA.gov users who have had a 20-second or more extended session.

Current state

DBEX UX Teams 1 and 2 have reviewed Medallia data in the last year, but focused on Feedback responses. Other product teams have described the Intercept survey appearing too early in the form; other teams (such as Debt) have explore moving the Intercept to the end of the form to avoid pop-ups and fragmenting the filing experience.


Tasks

Acceptance Criteria

pacerwow commented 1 month ago

@evelynhilbrichdavis I'd like to be Consulted on this task "Develop options for improving the survey" please. CC @lisacapaccioli in case you're also interested.

pacerwow commented 1 month ago

Open question - Is it possible to target the Veterans who see the new Toxic Exposure questions?

evelynhilbrichdavis commented 3 weeks ago

Confirming problems with our intercept survey distribution with a recent data pull. Of the 85 Intercept responses received for Medallia Intercept (July-Aug 9 2024), 65% of them were from the very beginning of the form.