Define and request landing page dashboard

[wesrowe]

Description

User story

As a Cartographers team member, I want a dashboard to display key UX health metrics for the MHV landing page, so that we can monitor its performance during and after the transition to MHV on VAgov.

Notes

• Current recommendation from the Platform Analytics team is that we file a request.
  • Michelle Dooley said in slack that Platform Analytics is taking Domo requests. She couldn't commit to a delivery date, but they do have several Domo experts on their team.
  • MD linked to an example request from the MR team
  • Also see slack convo for clarification on team docs we have to follow; e.g., MHV is an "edge case" – this just means it needs a custom dash, can't use a basic content KPIs template
• Potentially built on a platform that can aggregate data from multiple sources – Domo is the obvious recommendation per Platform docs
• My VA has a Domo dash that could serve as inspiration for us
• UPDATE: SM team built a simple dashboard in Datadog
• Maybe focus our MVP on qualitative feedback? Basil L (analytics team) built a "CSAT Score Dashboard" that has good charts and can filter by url. It's currently not useful for us since it requires a minimum of 400 data points for a URL to chart. Could he just duplicate that dash, focus only on the /my-health/ path to cut out the noise and obviate the need for the 400 limit?

Acceptance criteria

• Documented health metrics for the MHV landing page experience that can be monitored with analytics and/or feedback platforms (eg Medallia)
  • The landing page product outline may be the right place for this
• Created a request issue with the Platform Analytics team – probably an "edge case dashboard" like MR used, but confirm with Michelle Dooley

Tasks

• [ ]

[wesrowe]

refinement notes:

• estimate: medium given multiple team members discussion

[wesrowe]

What if we focus for our MVP on qualitative feedback? Basil L (analytics team) built a compelling "CSAT Score Dashboard" that has good charts and can filter by url. It's currently not useful for us since it requires a minimum of 400 data points for a URL to chart.

Note: for every chart, we would (like Basil) want to build parallel versions for various questions in both the Experience Survey (A11/intercept) and Satisfaction Survey (VFS/feedback button).

Charts of benefit:

• Average score and survey count: by week
• Average score and survey count: by directory (includes child pages; so e.g. SM would get a single column)
• Average score and survey count: by page

Scores:

• experience (A11/intercept)
• satisfaction (VFS/feedback button)
• task completion (% yes)
• trust change in VA
• trust in VA

[wesrowe]

Filed an analytics request ticket for an MVP dashboard. We'll see what happens.

[wesrowe]

Initial c-sat dashboard was delivered in Domo in March.

[wesrowe]

Robyn brought meeting together today with Patrick, Wes, Ann Costello-Kennedy, Jenny. Learnings:

• Domo generally not seen as a useful platform by octo due to various constraints
• PowerBI is VA enterprise standard for pulling together multiple analytics data sources; consider using it in place of Domo for ongoing reporting
• Datadog RUM is powerful for funnels, good place to watch signals during RUM retention period (currently 30 days); dd "Metrics" (custom metrics) are retained indefinitely, but need configuration

[wesrowe]

We have gone with Datdog for dashboarding the integration launch. This ticket ultimately superseded by #82690. Closing this one.