department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
282 stars 203 forks source link

[GTM Implementation Support] Education - How to Apply Wizard Tracking #4497

Closed jonwehausen closed 4 years ago

jonwehausen commented 4 years ago

Analytics Implementation or QA Request

Description

As an education benefits SME, I want to be able to understand how users are engaging with form wizards -- specifically here the how to apply wizard.

Resources + Notes

Acceptance Criteria

Definition of Done

jonwehausen commented 4 years ago

Developer Requirements

1) Perform the below dataLayer push on ANY toggle click of the radio buttons for the question Are you applying for a new benefit or updating your current education benefits?
dataLayer.push({
  'event': 'edu-howToApply-formChange', //remain consistent for all toggling
  'edu-form-field': 'benefitUpdate', //remain consistent for all toggling
  'edu-form-value': 'new' //dynamically populate according to selection -- other examples are 'Update', or 'STEM Scholarship'
});
2) Perform the below dataLayer push when the user clicks 'Apply Now'

🔴 For questions that are NOT answered by the user, pass null into the value for such question

dataLayer.push({
   'event': 'edu-howToApply-applyNow', 
   'edu-benefitUpdate': //i.e 'New', 'Update', 'STEM Scholarship'
   'edu-isBenefitClaimForSelf': //i.e 'Yes' or 'No'
   'edu-isNationalCallToServiceBenefit': //i.e 'Yes' or 'No' 
   'edu-isVetTec': //i.e 'Yes' or 'No'
   'edu-hasSponsorTransferredBenefits': //i.e 'Yes' or 'No'
   'edu-isReceivingSponsorBenefits': //i.e 'Yes', 'No', 'No with scholarship'
   'edu-isSponsorReachable': //i.e 'Yes' or 'No'
   'edu-stemApplicant': //i.e 'Yes' or 'No'
});
3) Perform the below dataLayer push for ANY link click contained within the Edith Nourse Rogers STEM Scholarship instructions (when the 3rd radio button to the first question is selected)
dataLayer.push({
   'event': 'edu-navigation', 
   'edu-action': 'check-remaining-benefits' //or 'stem-scholarship', 'see-approved-stem-programs'
});

SME Custom Dimension Mapping

Question Language Custom Dimension DL value
Are you applying for a new benefit or updating your current education benefits? Education - New Benefits Application edu-benefitUpdate
Are you a Veteran or service member claiming a benefit based on your own service? Education - Claiming Benefits for Oneself edu-isBenefitClaimForSelf
Are you applying for Veteran Employment Through Technology Education Courses (VET TEC)? Education Wiard - Applying For Vet Tec Courses edu-isVetTec
Are you receiving education benefits transferred to you by a sponsor Veteran? Education - Benefits Transferred By Sponsor edu-isReceivingSponsorBenefits
Has your sponsor transferred their benefits to you? Education - Benefits Transferred By Sponsor edu-hasSponsorTransferredBenefits
Is your sponsor deceased, 100% permanently disabled, MIA, or a POW? Education - Sponsor Available edu-isSponsorReachable
Are you claiming a National Call to Service education benefit? (This is uncommon) Education - Call to Service Benefit Claim edu-isNationalCallToServiceBenefit
Based on the eligibility requirements above, do you want to apply for this scholarship? Education - STEM Scholarship Applicant [EXISTING] edu-stemApplicant
nedierecel commented 4 years ago

@jonwehausen Thanks for sending and confirming receipt.

That makes sense we can't apply retroactively. Wonder if any of these new CDs can be used moving forward as global ones (e.g. claimingForSelf) in other product areas. It might be interesting to run this across the platform tools teams to see if they know of any global form questions that are commonly asked.

For the Learn More modal, do you want to insert a sample value, or are you scraping this?

jonwehausen commented 4 years ago

Hi @nedierecel ,

Thanks for our talk today. I have updated my earlier comment with our latest requirement needs.

@amyknox Would you mind giving my above comment a look to confirm?

Additional question -- we were planning on re-using custom dimension "Education - STEM Scholarship Applicant" to correspond with when the user is applying with the STEM Scholarship. Would this correspond with the selection of the third option in the first question? We also want to make sure we are accounting for any plans to modify / add questions. image

Feel free to notate any additional questions not yet covered above as well.

amyknox commented 4 years ago

@jonwehausen One thing that we discussed that I don't see specifically called out is that we're planning on a couple clarifying questions for the STEM scholarship to help applicants gauge if they're actually eligible to apply. We had talked about tracking whether they start down that path then back out. I don't know enough about GA to know if what you've proposed above makes that possible. If so, great. If not, can we add it?

At this point, we're still planning on having the 3rd question be the STEM one, but it won't be the one that triggers the appearance of the Apply Now button. That'd be a subsequent question in the flow.

jonwehausen commented 4 years ago

Hi @amyknox,

Thanks for your note here. Yes let's get that updated above.

At this time, could you provide a context of what those additional questions will ask and we will update the above specifications to reflect?

Thanks

amyknox commented 4 years ago

@jonwehausen - want to be sure you're aware we're still in discovery WRT the additional questions. Topics they may cover are listed below but the # and sepcific text of the questions are conceptual

Additional Wizard Questions re: STEM Scholarship

jonwehausen commented 4 years ago

Hi @amyknox ,

Understood - thanks for the notice and the context.

I've went ahead and updated the above comment with dataLayer variables for those 3 questions.

Can you confirm if these too will be yes/no answers?

amyknox commented 4 years ago

@jonwehausen - the questions we end up deploying will probably be yes/no. We will have a much better idea by the end of next week

jonwehausen commented 4 years ago

Hi @amyknox,

Wanted to touchbase here - has there been more discussion on refining the additional questions verbiage discussed prior?

Thanks, Jon Wehausen

amyknox commented 4 years ago

@jonwehausen - we are in the process of re-testing the education routing wizard and application early this week. Final content for the wizard will come out of this effort.

amyknox commented 4 years ago

@jonwehausen - This is where we landed with the Wizard.

The 3 options on the first question of the wizard aren't going to change. The language on #3 may change a little but the intent and all routing will be the same. That is... 1) Apply for a new benefit 2) Update current benefits 3) [apply to extend benefits with] STEM scholarship.

If the user selects option #3, they'll see conditional content with a question: Based on the eligibility requirements above, do you still want to apply for this scholarship? Y/N

If yes, they're directed to the 22-1995 form. If no they see: Learn what other education benefits you may be eligible for on the GI Bill eligibility page.

We'll want to track those people who first say yes then change their mind after seeing the eligibility criteria. Here's the screen in the testing prototype showing that view:
https://bahdigital.invisionapp.com/share/CHIACQ9ZB75#/screens/296030122

jonwehausen commented 4 years ago

Hi @amyknox,

Nedie and I were able to confirm the Developer Requirements above in the comments section.

When your team is ready to begin the DL portion, the requirements are ready to go.

Thanks, Jon Wehausen

sonntag-adam commented 4 years ago

https://github.com/department-of-veterans-affairs/vets-website/pull/11760

sonntag-adam commented 4 years ago

Screen Shot 2020-02-28 at 11.09.16 AM.png Screen Shot 2020-02-28 at 11.11.16 AM.png Screen Shot 2020-02-28 at 11.11.53 AM.png Screen Shot 2020-02-28 at 11.13.57 AM.png Screen Shot 2020-02-28 at 11.15.13 AM.png Screen Shot 2020-02-28 at 11.15.46 AM.png Screen Shot 2020-02-28 at 11.19.01 AM.png Screen Shot 2020-02-28 at 11.19.58 AM.png Screen Shot 2020-02-28 at 11.20.26 AM.png Screen Shot 2020-02-28 at 11.20.58 AM.png Screen Shot 2020-02-28 at 11.24.14 AM.png

sonntag-adam commented 4 years ago

@jonwehausen, @nedierecel, @amyknox

jonwehausen commented 4 years ago

Thank you @sonntag-adam for your work & documentation here! It's very much appreciated.

We will verify the DL as well as in-tandem with the QA testing of our tag management solution.

Stay tuned for another follow-up with our QA results.

jonwehausen commented 4 years ago

Hi @sonntag-adam,

At first look, we have a couple tweaks:

Thanks, Jon Wehausen

elder-joseph commented 4 years ago

Hey @jonwehausen , thanks for the feedback here. I'll go ahead and make these changes.

sonntag-adam commented 4 years ago

Screen Shot 2020-03-03 at 11.00.08 AM.png

Screen Shot 2020-03-03 at 11.05.03 AM.png

sonntag-adam commented 4 years ago

@jonwehausen, @nedierecel, @amyknox

jonwehausen commented 4 years ago

Hi @sonntag-adam,

Thanks for making these corrections!

@nedierecel and I would like to now verify within staging alongside our tag management implementation when your team is ready to push.

Thanks, Jon Wehausen

sonntag-adam commented 4 years ago

@nedierecel, @amyknox, @jonwehausen. This has been merged into staging.

jonwehausen commented 4 years ago

Thanks for the notice @sonntag-adam! Will be QAing today.

jonwehausen commented 4 years ago

QA Testing - 3/10/2020

✔️ Custom Dimension Mapping

✔️ First Question Radio Button Toggle

✔️ STEM Scholarship Link Clicks

Apply Now Submission Scenarios

image

image

image

image

jonwehausen commented 4 years ago

@nedierecel Please see above for examples of QA

nedierecel commented 4 years ago

Thanks @jonwehausen - Confirming receipt and validating the CDs against your screenshots. I'll post again with thumbs up that it's good to publish.

nedierecel commented 4 years ago

Toggles to Radio Button - PASSED

New Benefit image.png

Update Benefit image.png

STEM image.png

Apply Now Submissions

Custom dimension slots indicated in parentheses

Situation 1

Question Value Google Analytics Dimension Passed
Applying for Benefit New dimension64 Passed
Claim for Self Yes dimension65 Passed
Claim Natl. Call to Service Yes dimension66 Passed

image.png

Situation 2

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit New dimension64 Passed
Claim for Self Yes dimension65 Passed
Claim Natl. Call to Service No dimension66 Passed
Apply for VET TEC Yes dimension67 Passed

image.png

Situation 3

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit New dimension64 Passed
Claim for Self Yes dimension65 Passed
Claim Natl. Call to Service No dimension66 Passed
Apply for VET TEC No dimension67 Passed

image.png

Situation 4

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit Update dimension64 Passed
Transferred Benefits No dimension69 Passed

image.png

Situation 5

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit Update dimension64 Passed
Transferred Benefits Yes dimension69 Passed

image.png

Situation 6

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit Update dimension64 Passed
Transferred Benefits no - with scholarship dimension69 Passed

image.png

Situation 7

Question Value Google Analytics Dimension Passed or Not
Applying for Benefit stem-scholarship dimension64 Passed
Want to apply for STEM yes dimension49 Passed

image.png

nedierecel commented 4 years ago

@jonwehausen and @amyknox

The remaining QA items show that the navigation elements are all correct, as well as the form submissions I outlined in earlier QA session. Changes are ready to be published in Google Tag Manager.

Navigation Elements - PASSED

See the following:

  1. Edith Nourse Rogers image.png

  2. Check remaining benefits:

image.png

  1. See approved STEM:

image.png

Expected behavior - this should also generate a PDF event, as seen here:

image.png

desireeturner commented 4 years ago

@nedierecel can we go ahead and close this issue out now that you've confirmed everything is as expected? Thank you!

nedierecel commented 4 years ago

@jonwehausen I'll let @jonwehausen give thumbs up on closing when it's all published to Google Tag Manager. Thanks!

jonwehausen commented 4 years ago

@desireeturner @nedierecel @amyknox @joanneesteban @elder-joseph

Confirming this has been published!