Analytics Implementation for Income Limits web app

[wesrowe]

Status

[2024-07-12] [Fran] Comment/message added to ticket to Michelle Dooley regarding a full report (an interim report had been provided to Dave Conlon in Nov 2023).

Google Analytics Implementation or QA Request

What this form is for

More Information

Use this template to request Google Analytics implementation or QA for your product. Please fill out all brackets.

> _Please see the following information for implementation timeline:_ > New Teams: Implementation will usually be completed in 4 sprints > > - Sprint 1: Discovery/Orientation > - Sprint 2: FE Implementation > - Sprint 3: Tagging Implementation > - Sprint 4: QA > > All other teams: Implementation will usually be completed in 2 sprints > > - Sprint 1: Discovery and FE Implementation > - Sprint 2: Tagging Implementation and QA

Description

Required

• Is this request for Google Analytics implementation or QA?

  • [x] Google Analytics implementation (and DOMO)
  • [ ] QA

• Who is this request for?

  • Public Websites team

• Provide the link(s) for Google Analytics implementation or QA

  • Production URL is being finalized has been finalized – the base url of the tool will be va.gov/health-care/income-limits, with sub-pages having known URLs (below) (updated 6/29)

• When is the launch date?

  • anticipate mid-july launch

• What interactions need to be tracked? NOTE: Design System Components are automatically tracked

  • This product is like a form flow, and we would like to track the funnel in DOMO

  • Primary funnel: Current year flow (all URLs are on top of root url, /health-care/income-limits):

    • [root url]/introduction is starting point of flow (updated 6/29)
    • [root url]/zip
    • [root url]/dependents
    • [root url]/review
    • [root url]/results
    • Event: open accordion (this is complicated, see "other interactions" below)
    • va.gov/health-care/apply/application/introduction (existing page) = primary funnel ending

  • Secondary funnel: Past-year flow (adds year screen after intro, different end) – Can a single Domo dash have two funnels?

    • [root url]/introduction is starting point of flow (updated 6/29)
    • [root url]/year (This is additional to current-year funnel/flow)
    • [root url]/zip
    • [root url]/dependents
    • [root url]/review
    • [root url]/results
    • Event: open accordion (this is complicated, see "other interactions" below)

  • Primary goal – "Apply now" button click in current-year flow

  • Secondary "goal" – click one of the secondary links which we think of as a "learn more" path, for Veterans who are not yet ready to click "Apply now." I need your guidance on how to achieve this and whether custom GA events would be needed.

    • https://www.va.gov/health-care/eligibility/
    • https://www.va.gov/health-care/copay-rates/
    • https://www.va.gov/health-care/get-reimbursed-for-travel-pay/
    • https://www.va.gov/health-care/health-needs-conditions/mental-health/
    • https://www.va.gov/health-care/about-va-health-benefits/

  • Tertiary goal - other in-page links

    • I need your guidance, can we capture these in Domo without any custom GA events?
    • This would include links about mental health care, clicking the "call us" phone number link, etc.

  • [Other interactions - please review the Design System Components and GA Data Dictionary to make sure these interactions aren't already tracked]

    • Opening of accordions on the /results screen
    • There are 4-5 accordions here. We don't care which ones people open, but we're interested in how many they open. Our hypothesis for the happy path is that users identify a single income range and open it. But we would like to track how many accordions each user interacts with, in aggregate. I need your help identifying whether each accordion needs a unique GA event, with the goal of representing the "number of accordions interacted with" in Domo.
    • "Edit" flows - initiated by links on the /review screen, which enable the user to return to an input screen to change the input.
    • Editing is a pattern we want to monitor in DOMO - I need your help figuring out how best to track it and how to represent it in Domo. (It's sort of like a funnel pattern you could track with URLs, which would also catch use of the back button. We could also instrument the edit links with unique identifiers so that they can be disambiguated

Optional

• If applicable, what test users are needed? NOTE: Do not put staging credentials in this ticket; store or reference them in a .md file in the va.gov-team-sensitive repository

  • [Insert test user]

• Any additional comments

  • [Insert comments]

Please leave the following blank

Acceptance criteria

• [ ] All appropriate issue tagging is completed
• [ ] QA has been completed
• [ ] Events have been added to Product and Benefit Hub Content Groups

Additional information

Please refer to Platform Collaboration Cycle or the Analytics Request Touchpoint on Platform website for more information about the Collaboration Cycle.

[wesrowe]

@michelle-dooley, please let me know if you need me to do anything else to take this on. I left a few questions/clarifications in the ticket body, we can get to them when you pick this up.

[michelle-dooley]

@wesrowe - great thanks. I will review with team and back to you with any questions and timing.

[michelle-dooley]

@wesrowe - I have a few questions...

• The urls you provided do not yet exist, correct? If not do you have visuals you could share?
• Will they fall with in the current application process/flow funnel or are they separate?
• For the primary goal the 'Apply now' button is that a new button on one of those pages above? Is it different than the link on the left nav?
• For the "learn more" links will those be on those new pages or just tracking the left nav links to those pages?

[wesrowe]

@michelle-dooley,

• Visuals in this sketch file. The app is partly constructed on staging – content is lorem ipsum and very soon we'll add the introduction screen at the start.
• I need help answering your second question – the linked spreadsheet is about the 1010ez?
• You'll see the "Apply now" buttons in the sketch file. Note that there are four but they all go to the same place.
• The "learn more" links are the "more helpful information" links on the results screen. (I'm not sure what you mean by "left nav" in your question; see that there is no left nav in sketch file.)

[wesrowe]

@michelle-dooley, I just made a few updates to the request body above.

• Corrected a mistake: the root url is /health-care/income-limits, not just /income-limits
• Update from IA team: the first screen is not simply at the base url, it's [base-url]/introduction

[michelle-dooley]

@wesrowe - thanks for the info that was helpful and answered most my questions.

I do not see the "Apply now" button in sketch? I walked through staging and don't see there either. Where will it be? Will it be on the /income-limits/results page? And by clicking "Apply now" will that take me to the 'Apply for VA health care' flow or something else?

Tracking the "Apply now" and the other links on the page should be do-able. I also see the accordions are recording but I will have to look into if/how we can count/track per user session.

I am out next week but can plan to pick this up in the next sprint.

[wesrowe]

I do not see the "Apply now" button in sketch? I walked through staging and don't see there either. Where will it be? Will it be on the /income-limits/results page? And by clicking "Apply now" will that take me to the 'Apply for VA health care' flow or something else?

The "Apply now buttons" are actually CTA Links within the accordions, it sounds like you found those in Sketch. (They will be in the app probably next week.) And yes, those links open the "Apply for VA health care" page you linked.

[jilladams]

Hi @michelle-dooley FYI that we are working toward launch for Income Limits. Analytics are not launch blocking, but once we have an analytics scheme, we'd like to prioritize the FE work to implement the tracking. Just wanted to check in here re: any updates on potential timing, if any news. Thanks!

[jilladams]

This app has now launched: https://www.va.gov/health-care/income-limits/introduction. (as of 8/29)

[jilladams]

Accidental closure, reopening.

[FranECross]

Interim Funnel report provided to Dave today as an interim to the full report from Michelle et al https://analytics.google.com/analytics/web/#/analysis/p291016866/edit/sUOCnvhuSLGRBwHhTjVXEQ

[FranECross]

@michelle-dooley Question for you on this old ticket. 😉. As noted in the comment above, an interim report was provided to Dave Conlon, and I wanted to follow up to see if there is a full report available? Thanks in advance!

[jilladams]

@FranECross Michelle is now CMS program manager and isn't working the Analytics project anymore. From latest Analytics slide in the ToT deck, @johnny-jesensky-adhoc is the person who could help us with that moving forward.

[johnny-jesensky-adhoc]

@jilladams, @FranECross -- Hi both, thanks for tagging me, and for your patience as I got up to speed on this request and comment thread. I'm unable to access the old interim report...which based on the date it was linked, and URL, suspect it was part of an old Universal Analytics (UA) report, which is now defunct as of July 1, 2024.

@FranECross -- Do you happen to have any screenshots, or details of what was in that interim report? I can look into building something similar within GA4 quickly, and then, from the original request, we can try to build out something more robust in Domo.

FYI @Blivaditis