Analytics Implementation for Health Care Experience - Questionnaire

[mdewey]

Google Analytics Implementation

Description

• Is this request for Google Analytics implementation or QA? I believe this a request for implementation. We are a new product and not set up for GA yet. We are tracking events, but they not getting logged yet. We would like a new prefix (hcq-) to be tracked in GA.

Relevant slack thread for context: https://dsva.slack.com/archives/CBU0KDSB1/p1617721726370500

• Who is this request for?

  • Mark Dewey, FE Engineer on the Health Care Experience Team

• What team/project is this work for? this adds context for the data

  • Health Care Experience Team
  • Questionnaire App

• Provide the Domain where Google Analytics needs to be implemented

• www.staging.va.gov

• www.va.gov

  Identify if PII is passed in URL or title tag No PII is tracked at this time.

  • [Provide Domain here]

• Please provide any upcoming deadlines or important milestones

  • Looking to get to the Pilot site at the end of April.

• Typical Website Interactions to Track

  • Conversions - Understanding the User Flow: Provide URLs that are part of the application from the introduction page to successful form completion; conditional pages that are visible depending on an applicant's answer should be marked accordingly.

    /health-care/health-questionnaires/questionnaires
    health-care/health-questionnaires/questionnaires/to-do
    /health-care/health-questionnaires/questionnaires/completed
    /health-care/health-questionnaires/questionnaires/answer-questions/introduction?id={appointment-id}
    /health-care/health-questionnaires/questionnaires/answer-questions/veteran-information
    /health-care/health-questionnaires/questionnaires/answer-questions/prepare-for-your-appointment
    /health-care/health-questionnaires/questionnaires/answer-questions/review-and-submit
    /health-care/health-questionnaires/questionnaires/answer-questions/confirmation

  • Other User Interactions: Provide details on other interactions and metrics, like click to help text links, that are helpful in understanding user behavior.

• Changing tabs

• Printing PDFs on the Questionnaire List page

• Printing PDFs on the Confirmation page

• Loading Data from an API

Sample Users when authentication is required do not put staging credentials in your va.gov-team ticket; store or reference them in a .md file in the va.gov-team-sensitive repository

-We are working through getting actual test users. Currently works with any test user.

Please leave the following blank

Acceptance Criteria

• [ ] QA has been completed
• [ ] Events have been added to Product and Benefit Hub Content Groups
• [ ] VFS team completes brief VSP Collaboration Cycle Feedback survey

Definition of Done

• [ ] All appropriate issue tagging is completed
• [ ] All AC completed
• [ ] VSP: Platform Collaboration Point Tracker is updated

[laurensimpson14]

@jonwehausen See notes below. All changes are in the GTM workspace "22828 Health Care Experience - Questionnaire". I believe this is ready for QA.

Changing tabs: This is already being collected as event action (both Navigation - Tab Click - hcq-Completed and Navigation - Tab Click - hcq-To do) and can be seen in the prod GA property: https://analytics.google.com/analytics/web/#/report/content-event-events/a50123418w178298118p176884211/_u.date00=20210409&_u.date01=20210409&explorer-segmentExplorer.segmentId=analytics.eventAction&explorer-table.plotKeys=%5B%5D&explorer-table.filter=tab%20click/

Printing PDFs on the Questionnaire list page and confirmation page: I've created a new tag called EV - HCQ Print PDF that fires on a new trigger and is set to look for every time the _event matches hcq-pdf-printed. This will get stored in GA as an event with category = Interactions, action = Downloaded HCQ PDF, label = {{Event}} (hcq-pdf-printed).

I've seen this work in GTM debug for the list page, however I'm not sure how to test it on the confirmation page.

Loading Data from an API: I've updated the trigger CE - bam-(get.*|cards.*)|hcq.* to include ^hcq.* in the regex. I also updated the variable RegEx - Product API Calls - Event Action Lookup to look for any event with ^hcq.* and return Health Care Questionnaire.

This is another one that I'm not sure how to test.

[jonwehausen]

Review

Thanks for jumping on this @laurensimpson14, please see my notes below.

Primary Notes

• @laurensimpson14 the 'nav-tab-click' event is perfect here -- that said we should have @mdewey remove the product prefix of hcq from the 'tab-text' variable -- we'll know this is the health care questionnaire by the page URL in GA. The hcq should only be used as a prefix within 'event' or as a prefix for associated data layer variables
• Recommendation here to remove your tag EV - HCQ Print PDF tag and instead attach your trigger of CE - HCQ Print PDF as a secondary trigger to Event - Any File Download. Since there's no {{Click URL}} here for additional context to flow into the Event Action, we could propose a data layer design to Mark to give us the context we need to identify the type of questionnaire.
• The Product-Based API calls is a great tag to expand on here for the -loaded events -- though you should tweak to ensure you're not also firing this Product-Based API Calls tag in other areas where we're using hcq, you could change ^hcq.* to ^hcq-questionnaires.* if that's the convention Mark used for each of the loaded events.

QA Testing

Description of Interaction	Data Layer Screenshot	Test Status
Submission of health care questionnaire		⚠️ DOES NOT PASS @mdewey the --submission event is perfect, though we did not see a secondary hcq--submission-successful event as expected here and not sure we should also be seeing an additional sip-form-saved but realize that may have been an auto-fire. We would expect to see a --submission-failed event in the event of a failed submission.
Click to print hcq application from /confirmation page (used vets.gov.user+228@gmail.com)		✔️ PASS - for hcq-pdf-printed event Though we may want to consider adding in a failed event or error-key DL variable for when the download fails

Other Recommendations / Things To Consider

• Notice the id parameter in the URL of /answer-questions -- we should include ID as an exclude GA parameter as not to pull this in each time
• @mdewey would you all be interested in expired questionnaires on /answer-questions/introduction

[jonwehausen]

Shifting back to Stand By

[mdewey]

Hey Folks!

All great stuff so far, I want to sum up what I saw

• A couple of different views have been set up for us. Thanks, awesome!!! I haven't checked them out but will forward these to my PM (@leahkeeler) and get her thoughts
• I have added the failed event for the submitting of the form
• I have divided the loading of the PDF into a fail event and a successful event
• RE: Expired questionnaires. That would be nice to track, I have a PR open that will start to track the hcq-questionnaire-expired-loaded event.
• Another question, we also want to track users that are coming to our site from either an email or a text. I know we can do this with utm- parameters. What URL parameters do we need to use for that?

Thank you all so much!

[leahkeeler]

Looks good guys - are we collecting 1) total time to complete 2) IF abandoned, what place in the funnel?

[laurensimpson14]

Hi Everyone,

@jonwehausen I've made your above recommended changes within the GTM workspace (removed the EV - HCQ Print PDF tag, attached trigger of CE - HCQ Print PDF as secondary trigger to Event - Any File Downloaded, tweaked the product-based API calls tag to use ^hcq-questionnaires.*)

@leahkeeler Yes, we are collecting time to complete and abandons within the funnel. The time to complete metric and abandons metric aren't something that can be pulled through Google Analytics, they require us to write a query within BigQuery. We're trying to standardize that as part of our KPI dashboard standardization work, so you'll have visibility to both of these metrics.

@mdewey

• I see the failed event for submitting the form is firing now!

  QA Testing

  Description of Interaction	Data Layer Screenshot	Test Status
  Submission error of health care questionnaire		✔️ PASS --validation-failed event in the event of a failed submission.

• For tracking users coming from email or text, I'd recommend adding the following utm parameters:

  • Text: "?utm_medium=referral&utm_source=VEText&utm_campaign=your_campaign" (If you'll be using something other than VEText please let me know because we may need to change this)
  • Email: "?utm_medium=email&utm_source=govdelivery&utm_campaign=your_campaign" (If you'll be using something other than govdelivery please let me know because we may need to change this)

• Would you be able to please remove the product prefix of hcq from the tab-text variable? We'll know this is the health care questionnaire by the page URL in GA.

[mdewey]

Thanks for the info @laurensimpson14!

• I am tagging @kristenmcconnell and @leahkeeler to note the URLs for tracking email vs text. That will have be taken into consideration as we get our email and texts configured.

• I will go in and remove the hcq from the tab-text

Apart from the removal of the prefix, what other action items are needed from the team?

[laurensimpson14]

@mdewey I think that's everything from your team.

@jonwehausen You QA'd this ticket a while back & I've updated the workspace since then with your recommended changes. Would you mind taking one more look before publishing?

Shifting this back to QA.

[jonwehausen]

QA Round 2

@mdewey Data layer has PASSED here, there are just remaining updates on our part for GTM we'll need to adjust.

Description of Interaction	Data Layer Screenshot	Tag Screenshot	Data Layer Test Status	GTM Tagging Test Status
Click on "Completed" tab			✔️ PASS	✔️ PASS
Click on the "To Do" tab			✔️ PASS	✔️ PASS
HCQ questionnaires loaded			✔️ PASS	✔️ PASS
Click to print "View and print questions" button (successful render of the pdf)		N/A	✔️ PASS	⚠️ DOES NOT PASS
Submission of the health care questionnaire		N/A	✔️ PASS	⚠️ DOES NOT PASS
Successful submission of the health care application		N/A	✔️ PASS	⚠️ DOES NOT PASS

@laurensimpson14 Please see test status above -- we're going to need to make the necessary tag adjustments according to the test status above

[laurensimpson14]

@jonwehausen I've tweaked those DL items and added in an exclusion query parameter for id in GA.

[jonwehausen]

Final QA

Test User: va.api.user+idme.101@gmail.com

Description of Interaction	Tag Screenshot	GTM Tagging Test Status
Click to print "View and print questions" button (successful render of the pdf)		✔️ PASS
Submission of the health care questionnaire		✔️ PASS
Successful submission of the health care application		✔️ PASS
Failed submission of the health care application		✔️ PASS
Validation failed		✔️ PASS

Other Tests

• Benefit hub content grouping set to "Health Care" 👍
• Product content grouping set to "Health Care - Questionnaire" 👍

[jonwehausen]

@mdewey GTM tagging QA has been completed and passed. Ticket being closed.