department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
278 stars 195 forks source link

Explore Domo for Quarterly Quantitative Metrics #87700

Open oddball-lindsay opened 4 days ago

oddball-lindsay commented 4 days ago

Background

Quarterly metrics include user-initiated feedback, which does not come often enough to be considered significant, so we've decided to check on a quarterly basis instead of monthly.

I'm curious to see if we can track the quantitative feedback in Domo.

These are the four A11 Questionnaire quantitative questions:

  1. VA.gov experience (rating 1-5)
  2. VA.gov understanding (rating 1-5)
  3. General VA trust (rating 1-5)
  4. Trust in VA commitment to Veterans (rating 1-5)

Best case, we show a bar chart of all four questions, where each bar represents the average across time.

These are the two VFS Questionnaire quantitative questions:

  1. Were you able to do your task today? (yes/no)
  2. What is your overall satisfaction with this site? (rating 1-5)

There is also the good/bad survey at the bottom our FAQ pag:

  1. How do you rate your experience on this page? (good/bad)

Tasks

Acceptance Criteria

oddball-lindsay commented 4 days ago

Existing Domo dashboards:

  1. Medallia Report - covers landing page, FAQ page and Find a Rep.
    1. A11: VA.gov experience (rating 1-5) ✅
    2. A11: VA.gov understanding (rating 1-5) - not in this report
    3. A11: General VA trust (rating 1-5) - unsure if this is in the report (is it the gauge with "How did this interaction change your trust in VA"?)
    4. A11: Trust in VA commitment to Veterans (rating 1-5) ✅
    5. VFS: Were you able to do your task today? (yes/no) ✅
    6. VFS: What is your overall satisfaction with this site? (rating 1-5) ✅
  2. Content Engagement KPIs - page_title covers landing page and Find a Rep. Does not seem to include FAQ page. Including for reference as there may be interesting metrics for us to look at (click interactions, depth of engagement, findability), unsure though if those would be monthly or quarterly.

Need to ask A where the FAQ good/bad survey is tracked and if there's anything in Domo to reference.

oddball-lindsay commented 1 day ago

For the FAQ good/bad survey -- one of the OCTO content leads creates a doc each month and links to a spreadsheet with all of the articles and their numbers. You can find them all here.