Closed alexseelig closed 10 months ago
DATA DOG FINDINGS: here is a typical example of how a chain of errors can occur on page load before the user gets the chance to press a start application button.
Listed above is a detailed view of the errors flagged when the experience of the start of the application is not working appropriately.
list of browsers that were used during these error actions during the last 30mins
-- List of browsers -- Edge 111.0.1661.62 Facebook 406.0.0 Google 256.2.518341946 Mobile Safari 16.3 Safari 16.3Chapley suggested that based off the order / type errors fired off, He is betting that some html is supposed to be loaded during that load process, it isn't getting loaded, and the returned value is likely a blank string.... so the getElementById is naturally going to die as strings don't have that method... there's likely an ajax call that is dying there.
As a team member, I would like to understand how users interact with the 1010 forms so that I can understand their pain points, their successes, and ensure that as many Veterans have easy access to care as possible.
One issue that was identified: A small percent of monthly applicants were having issues with the start application buttons within the 1010ez form
Do Analysis on Start Button issue and determine cause and effect
[x] Work with team to figure out what the JavaScript means
[ ] Determine what Browsers users are having issues on
[ ] Test against older mobile browsers (Blocked for Browserstack license)
[ ] Come up with solution, either with JS replacements, or a notification for users to update their browser
[ ] See if there is a front end solution (maybe reach out to platform team)
[ ] Work with Benefits group to divide and conquer
[x] Review and triage list of errors
[x] Review Medallia survey results
[x] Review Analytics and discuss with team
[x] Review Datadog RUM recorded sessions
[x] Review video replays (not loading)
[x] Review and triage list of errors
[ ] Come up with list of findings about success and impediments
[x] Share findings with team
[ ] Come up with list of fixes/enhancements/etc. for the team
[ ] Come up with list of metrics/behaviors to track/follow going forward
Repeat the above for the CG Form Review and triage list of errors
[ ] Review Medallia survey results
[ ] Review Analytics and discuss with team
[ ] Review Datadog RUM recorded sessions
[ ] Review video replays
[ ] Review and triage list of errors
[ ] Come up with list of findings about success and impediments
[ ] Share findings with team
[ ] Come up with list of fixes/enhancements/etc. for the team
[ ] Come up with list of metrics/behaviors to track/follow going forward
AS Note: leaving Epic Outline down below in case we need to turn this into an Epic
Product Outline
Link
High Level User Story/ies
As a Data analyst, I need to research & vet the feedback given by veterans trying to apply for medical benefits; so I can suggest areas of improvement for the broader team to address and facilitate a better user experience within the 1010 forms.
Background Context
Per the DOMO KPI dashboards for the 1010ez form; roughly 84% of users do not make it past the first 7 steps of the application. There are many reasons why a veteran would not go past the first couple of step of the form outside bugs and errors. However, there is a wealth of feedback data from veterans that has not been utilized, we wanted to understand what were veterans pain points on the up front of the form.
Hypothesis or Bet
If We identify the hurdles or problem areas of users trying to apply for medical benefits Then We can expect that applicant drop off rate will decrease on the upfront of the 1010ez form.
OKR
A measurable decrease in applicant drop off rate within the first 7 steps of the 1010ez application funnel.
Definition of done
When we can spin up a few stories for the boarder team to bring to stakeholders' attention and address those issue, if any.
What must be true in order for you to consider this epic complete?
N/A
Take into consideration Accessibility/QA needs as well as Product, Technical, and Design requirements.
How to configure this issue
product support
,analytics-insights
,operations
,Console-Services
,tools-fe
,content-ia
,service-design
,vsa-*
)backend
,frontend
,devops
,design
,research
,product
,ia
,qa
,analytics
,contact center
,research
,accessibility
,content
)