Analytics Implementation for 22/1995

[jonwehausen]

Analytics Implementation or QA Request

Description

Tracking needs: (https://app.zenhub.com/files/133843125/61b7c180-8f9b-4652-ba4a-53efd9dd5190/download)

• Who is this request for?

  • [BAH - Amy Knox, Theresa McCurdo, Cindy Cruz]

• What team/project is this work for?

  • Education - Booze Allen Hamilton - Form 22/1995

• Provide the Domain where Google Analytics needs to be implemented i.e. www.staging.va.gov

  • Form starting point: https://bahdigital.invisionapp.com/share/9GIACS4WX82#/screens/296030718
  • Updated STEM questions: § https://bahdigital.invisionapp.com/share/9GIACS4WX82#/screens/296030728
  • NEW Ineligibility alert page: https://bahdigital.invisionapp.com/share/9GIACS4WX82#/screens/296030743

• Please provide any upcoming deadlines or important milestones Week of March 9

• Test Users to replicate the event do not put staging credentials in your va.gov-team ticket; store or reference them in a .md file in the va.gov-team-sensitive repository

Acceptance Criteria

• [ ] Datalayer has been implemented
• [ ] Google Tag Manager configuration has been completed
• [ ] QA has been completed
• [ ] VFS team completes brief VSP Collaboration Cycle Feedback survey

Definition of Done

• [ ] All appropriate issue tagging is completed
• [ ] All AC completed

[jonwehausen]

Datalayer Requirements - Updated 3/2 9:00am EST

1) When the veteran reaches ineligibly page and clicks a radio button for yes or no

Screenshot of message

Perform the following dataLayer push on ALL clicks of yes or no:

dataLayer.push({
  'event': 'edu-form-change', 
  'edu-form-field': 'ineligibility-still-apply-radio-button',
  'edu-form-value': 'yes' //or 'no' 
});

2) When the veteran clicks on any of the following navigation components:

• Explore Other Benefits
• Finish Later

Screenshot of interaction

Execute the following dataLayer push

dataLayer.push({
   'event': 'edu-navigation', 
   'edu-action': 'explore-other-benefits' //or 'finish-later', 
});

DEV IGNORE - Setup GA Sequence Segments - @nedierecel

• Thinking about this differently, I like your suggestion of performing the dataLayer push on any and all radio button clicks
• Let me know your thoughts here -- In order to meet the request of understanding interactions immediately following the radio button click, we would need to setup sequence segments similar to this screenshot for each interaction (continue, back, finish later, etc)
• For the exit / browser close scenario, we can set the second half of the sequence condition to be "Exit Page = <_whatever page we need_>, in this case education/apply-for-education-benefits/application/1995/benefits/stem

3) When the veteran SUBMITs the form, add the following dataLayer variable to the existing 'edu-1995--submission-successful' event push based on the veterans response to the new question

Screenshot of question

Add this dataLayer variable

'edu-exhaustedAllBenefits': 'yes' //or 'no'

4) When the veteran clicks on any of the links within the STEM scholarship block

Screenshot of section

Execute this dataLayer push

dataLayer.push({
   'event': 'edu-navigation', 
   'edu-action': 'check-remaining-benefits' //or 'stem-scholarship', 'see-approved-stem-programs'
});

[nedierecel]

@jonwehausen Thanks for including me in the review. Please see feedback by each requirement.

1. Mid-form dataLayer push
   • Existing Tag: If you think it aligns with your logic and intent, there is an existing tag for "Education Navigation" with a look up table: https://tagmanager.google.com/#/container/accounts/144676348/containers/2214120/workspaces/734

• Approach: I think you're right that this is an edge case, where we don't typically configure events at the continue or back level. Do you think this should be handled like a gibct-formChange whereby it happens at time of selection? My concern is how this might be sent with the browser close.

2. This looks good--thanks for making it a global solution
3. I recommend using the edu-navigation event that exists in GTM now. You could use the look up table built within this tag to form the "Event Action".

[jonwehausen]

Hi @nedierecel,

Thanks so much for your recommendations! I have updated the above comment to be version 1.1 with the latest requirements.

Thanks!

[amyknox]

@jonwehausen It looks like you have two #3's in comment v1.1 above.

3) When the veteran SUBMITs the form, add the following dataLayer variable to the existing 'edu-1995--submission-successful' event push based on the veterans response to the new question and 3) When the veteran clicks on any of the links within the STEM scholarship block

The screenshot that accompanies the first #3 doesn't look like it goes with the description (screenshot: exhaustion of benefits question; datalayer push: form submission success )

[jonwehausen]

Hi @amyknox,

Oops! Thanks for your observations. I have corrected the numbering above.

Regarding now #3 above, apologize if the screenshot was confusing... To clarify, we want to add the dataLayer variable 'edu-exhaustedAllBenefits' to the existing 'edu-1995--submission-successful' event at time of form submission.

@nedierecel Keep us posted on the status of your final review given the most recent updates.

Thanks Jon Wehausen

[nedierecel]

@jonwehausen Confirming receipt--I have some recommendations on the continue and back buttons, so I'll thread in a discussion on Slack.

[jonwehausen]

@nedierecel Have updated the requirements above based on our conversations from last week:

• Removed continue/back button events as were deemed unnecessary
• Updated screenshot and datalayer to only perform the push on explore-other-benefits and finish-later
• Updated screenshot of sequence segments to reflect explore other benefits scenario

[nedierecel]

@jonwehausen @amyknox This is approved.

Jon, once data is available on Staging, you and I can look at the various report options (segments, custom funnels, and behavior flow). Thanks.

[hughes-dustin]

@jonwehausen @nedierecel The "Finish this application later" link is platform specific. We don't have any control over it in 1995 so I don't think we can push any event to the datalayer there.

I did notice however that the action is being tracked asevent: "edu-1995-sip-form-saved" in the datalayer.

[jonwehausen]

@hughes-dustin Thanks for the note here -- Okay, that is fine. We can do without and utilize the existing event where needed.

[hughes-dustin]

branch: bah-6092 PR: https://github.com/department-of-veterans-affairs/vets-website/pull/11824

[sonntag-adam]

[sonntag-adam]

@jonwehausen, @amyknox, @nedierecel

[nedierecel]

Thanks @sonntag-adam - Has this also been pushed to staging? We updated a few settings in Google Tag Manager that we need to validate.

[jonwehausen]

Hi @sonntag-adam ,

Thanks again for your work here! We really appreciate it.

Through our testing, we noticed a small update to correct -- We noticed a 'Yes' radio button selection of "Have you used all of your Post-9/11 GI Bill or Fry Scholarship benefits or do you have less than 6 months of benefits left?" is populating with 'No' at form submission for the edu-exhaustedAllBenefits dataLayer variable.

Please see screenshot.

Remaining Validation

✔️ STEM Scholarship Radio Button

• Validates the on-click event tag for Yes and No

✔️ 'Explore Other Benefits'

• Validates the on-click event tag for Explore Other Benefits

CC: @amyknox @nedierecel

[hughes-dustin]

@jonwehausen

Can we get a little more information? I've attempted to recreate the scenario but am getting the expected results.

[hughes-dustin]

For exhaustionOfBenefitsAfterPursuingTeachingCert tracking:

Branch: bah-6092-2 PR: https://github.com/department-of-veterans-affairs/vets-website/pull/11868

[jonwehausen]

Hi @hughes-dustin ,

Thanks, the edu-exhaustedAllBenefits seems to be working fine, ran a couple more tests to confirm.

[sonntag-adam]

@jonwehausen here is an update with your prior selection of

edu-stemApplicant: "Yes" edu-undergradStem: "No" edu-pursueTeaching: "Yes"

And selection yes and no for the question "Have you used all of your Post-9/11 GI Bill or Fry Scholarship benefits or do you have less than 6 months of benefits left?(*Required)"

Is this what we want for functionality?

[jonwehausen]

Hi @sonntag-adam ,

Thanks for confirming. Yes -- this is correct.

@hughes-dustin is confirming this functionality also for when the Pursuing Teaching question is NOT surfaced. Like in the screenshot below.

[sonntag-adam]

@jonwehausen here is the scenario above for both yes and no

[nedierecel]

@jonwehausen Confirming I am reviewing now so changes can be published.

[jonwehausen]

@nedierecel @sonntag-adam @hughes-dustin @amyknox

Confirming this has in fact been published. Closing.