search

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
282 stars 203 forks source link

General Analytics Request for Search & Discovery Team - Right Rail Data #20168

Closed denisecoveyduc closed 3 years ago

denisecoveyduc commented 3 years ago

Metrics Reporting Request

What this form is for

Use this template to request one-off performance, usability, or outcomes va.gov metrics that is difficult to access or that needs analytics interpretation. If you have your KPIs set, please request a KPI dashboard.

Insights will usually provide data reports within the current sprint, but if there is time-sensitivity, please note them in "additional comments."

Instructions

Please fill out the following sections:

Description

Who is this request for?

Timeframe for Analytics Requested

What timeframes are you looking to analyze (e.g. before vs. after dd/mm/yy)?

Analytics to Track Down

  • [ ] Would like to get a better understanding of how many users are clicking on the links in the right rail on the search result page.

Right Rail Links.png

Which Product Questions are you trying to answer?

Other Helpful Questions to think through

Link to Metrics

n/a

Additional Comments

Hopefully this is a singular ask.

Please leave the following blank

Acceptance Criteria

Definition of Done

jonwehausen commented 3 years ago

Next Steps

denisecoveyduc commented 3 years ago

Hi @laurensimpson14 just wondering if we have any ETA for this report link? cc: @jonwehausen

laurensimpson14 commented 3 years ago

Hi @denisecoveyduc,

I've pulled a report to show the total number of clicks to the right rail on the search results page. The date range is set to Jan 1, 2019 - March 23, 2021. In your request you asked for it to go to Jan 31, 2021, but Google Analytics will not allow the end date to be set in the future. If you meant to put Jan 31, 2020 then you can modify the dates using the date range found in the top right corner: https://analytics.google.com/analytics/web/#/report/content-event-events/a50123418w177519031p176188361/_u.date00=20190101&_u.date01=20210323&_r.drilldown=analytics.eventCategory:Interactions&explorer-table.plotKeys=%5B%5D&explorer-table.advFilter=%5B%5B0,%22analytics.eventAction%22,%22PT%22,%22Navigation%20-%20Search%20Results%20-%20More%20VA%20Search%20Tools%22,0%5D%5D/

Please note - the report above may take a while to load! Also, in the report I linked above ^ there are 6 results as opposed to the existing 5 in the menu. It looks like item #6 (VA handbooks and other publications) was renamed or removed.

I know your goal is to see if this menu is helpful to users, so I've also pulled a report on how many pageviews the search results page has gotten in the same time period. The report linked above shows that the menu was clicked on 240,198 times, and this report shows that the search results page was viewed 12.4 million times - so nearly 2% of all pageviews used the right rail menu: https://analytics.google.com/analytics/web/#/report/content-pages/a50123418w177519031p176188361/_u.date00=20190101&_u.date01=20210323&explorer-table.plotKeys=%5B%5D&_r.drilldown=analytics.pagePath:www.va.gov~2Fsearch~2F/

I hope this helps you with analyzing the benefit of the menu.

Please let me know if these links fully address your request and if you need anything else.

denisecoveyduc commented 3 years ago

Hi @laurensimpson14 this is fantastic thank you! As we hypothesized those links aren't being used that frequently. As we explore how to integrate those into our new designs we wondered how their usage compares to the other search tools we have identified. What we would love to understand is how to sort this list by popularity (aka usage) so that we highlight the most frequently used search tools first. Do you know if there are existing GA reports or DOMO dashboards that we could review for the following search tools?

GI Bill® Comparison Tool Find a Yellow Ribbon school Resources and Support Grave Locator Find Locations Find a Facility

laurensimpson14 commented 3 years ago

Hi @denisecoveyduc I've done a search and I haven't found any search-related dashboards. If you're looking for a quick way to glance at popularity and compare overall search volume across all products I can create a small custom report in GA with each of those search start pages and unique searches. I should have time to get this completed on Monday afternoon.

laurensimpson14 commented 3 years ago

@denisecoveyduc I've created a custom report to show popularity/usage by the number of pageviews of each of the tools. The only tool that I was not able to include was the Grave Locator tool. Unfortunately, I'm not able to get data for that page since we don't attach it to our GA property.

Here is a link to the report: https://analytics.google.com/analytics/web/template?uid=0-uCbBC2T0WTT4mIQ3iXSQ For the View select VA.gov - Production > All VA.gov Website Data [Production] (176188361). You can change the date range in the top right corner.

Below is a list of what search tool the column "Page path level 2" is referencing in the report.

  1. /find-locations/ - Find a Location Tool
  2. /search/ - Site Search Tool
  3. /gi-bill-comparison-tool/ - GI Bill Comparison Tool
  4. /resources/ - Resources and Support
  5. /education/ - Find a Yellow Ribbon School
  6. /directory/ - Find a Facility

Please let me know if this addresses your request, if you need anything else, or if this ticket is OK to close out.

denisecoveyduc commented 3 years ago

@laurensimpson14 Thank you! This is very valuable information for us and exactly what we were looking for. Ok to close out this issue now.

cc: @MarciMcGuireGCIO I will DM you but worth looking at this information from your perspective as well. If you change the data range for the FY 2020 you can see form related searches appear on rows 7,11,13,15 and 16

cc: @johnhashva FYI - We anticipate using this information to inform the results page redesign @mgleo is working on now.

laurensimpson14 commented 3 years ago

Wonderful, I hope you have a great rest of your day!

cindymerrill commented 3 years ago

@denisecoveyduc I appreciate you sharing the links to these analytics reports with me (during a meeting yesterday), but I'm unable to see the reports. When I click on the link, I get taken to the "Welcome to Google Analytics" page instead. Is there something not set up correctly in my account, or do I need to have some additional access or privilege?

denisecoveyduc commented 3 years ago

@laurensimpson14 Can you advice? Will Cindy or others require special permission to access this report? Thanks in advance.

laurensimpson14 commented 3 years ago

@cindymerrill It looks like you have the right permissions in GA to be able to view the report (under the email cindy.merrill@adhocteam.us). Is it possible that you were trying to access it under a different account?

When you click the link to the report it should ask you to select a View. The View in this case is under VA.gov - Production > All VA.gov Website Data [Production].

As long as the individual trying to access the report has access to the "All VA.gov Website Data [Production]" view in GA, then that link should work for them. Please let me know if you're still running into trouble!

cindymerrill commented 3 years ago

Hi Lauren,

I was at first in the wrong google account, and when I changed it, here's what I see (is this the report I'm supposed to be seeing?):

[image: image.png]

On Thu, Apr 1, 2021 at 10:46 AM Lauren Simpson @.***> wrote:

@cindymerrill https://github.com/cindymerrill It looks like you have the right permissions in GA to be able to view the report (under the email @.***). Is it possible that you were trying to access it under a different account?

When you click the link to the report https://analytics.google.com/analytics/web/template?uid=0-uCbBC2T0WTT4mIQ3iXSQ it should ask you to select a View. The View in this case is under VA.gov - Production > All VA.gov Website Data [Production].

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-812067891, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7VYVEFMKH6ZPQTYXUO3TGSWOTANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

@cindymerrill Would you mind re-attaching the screenshot? I'm only seeing text saying that there is an image, but I don't see the actual image.

cindymerrill commented 3 years ago

Here it is (guess it didn't attach when I replied via email): image

cindymerrill commented 3 years ago

I appear to not have the access I need to see the dashboards that @brianalloyd and @denisecoveyduc have showed me, so maybe that's the same reason I'm not seeing your reports correctly.

laurensimpson14 commented 3 years ago

From what I can tell you have the right permissions, so I'm not sure what could be causing the issue. I'm looping in @jonwehausen. Jon, can you help us figure out why Cindy is not able to view the reports?

jonwehausen commented 3 years ago

Thanks for investigation @laurensimpson14

@cindymerrill -- Certainly strange you have not been able to view reports up to this point..., we apologize for the inconvenience -- At this time I temporarily removed and re-added cindy.merrill@adhocteam.us. Please check your email for a GA invitation and accept the invite, if after acceptance you're still not able to see reports, we may need to jump on a call briefly and do a screen share to further diagnose what may be happening here.

Thanks so much.

cindymerrill commented 3 years ago

I accepted your new GA invitation, but still I can't see any reports. Whenever I click the link of a GA report, I see a "Welcome to Google Analytics" page with my personal Google account (I can tell by the profile picture). So I change to my Ad Hoc Google account, and then I see a GA screen, which is not the report that was just shared with me.

Also, I'm unable to open some DOMO dashboards, such as this one that Brian wanted me to see: https://va-gov.domo.com/page/1522082003

Yes, please let's meet and do a screen share so you can see what's going on.

Thanks!

--Cindy

On Mon, Apr 5, 2021 at 4:10 PM jonwehausen @.***> wrote:

Thanks for investigation @laurensimpson14 https://github.com/laurensimpson14

@cindymerrill https://github.com/cindymerrill -- Certainly strange you have not been able to view reports up to this point..., we apologize for the inconvenience -- At this time I temporarily removed and re-added @.*** Please check your email for a GA invitation and accept the invite, if after acceptance you're still not able to see reports, we may need to jump on a call briefly and do a screen share to further diagnose what may be happening here.

Thanks so much.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-813701369, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7V7OW7Z2PKUVPLEY5PDTHI7NJANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

@cindymerrill Would you be available tomorrow to do a screen share? Any time between 9:00 am - 11:00 am EDT, 12:00 - 12:30 pm EDT, or 3:00 - 4:00 pm EDT.

cindymerrill commented 3 years ago

I could do 12-12:30 or 3-4 pm Eastern.

--Cindy

On Tue, Apr 6, 2021 at 6:55 AM Lauren Simpson @.***> wrote:

@cindymerrill https://github.com/cindymerrill Would you be available tomorrow to do a screen share? Any time between 9:00 am - 11:00 am EDT, 12:00 - 12:30 pm EDT, or 3:00 - 4:00 pm EDT.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-814141096, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7V3ISMIHIEJT2J2VIN3THMHG7ANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

Great - I just sent you a calendar invite for 3:30 pm!

cindymerrill commented 3 years ago

Sorry, Lauren--I thought you were scheduling for today, not tomorrow. From the times you list for tomorrow, I'm available only from 3-3:30, and I have a hard stop at 3:30.

--Cindy

On Tue, Apr 6, 2021 at 6:55 AM Lauren Simpson @.***> wrote:

@cindymerrill https://github.com/cindymerrill Would you be available tomorrow to do a screen share? Any time between 9:00 am - 11:00 am EDT, 12:00 - 12:30 pm EDT, or 3:00 - 4:00 pm EDT.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-814141096, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7V3ISMIHIEJT2J2VIN3THMHG7ANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

The appointment that I had scheduled at 3:00 is flexible, so I can still do that time. I've moved the invite to 3:00 pm tomorrow, let me know if that still works for you!

cindymerrill commented 3 years ago

Hi Lauren,

Thank you for all your help today! At the moment, here's the only DOMO dashboard that I don't currently have access to but would like to:

--Cindy

On Tue, Apr 6, 2021 at 12:31 PM Lauren Simpson @.***> wrote:

The appointment that I had scheduled at 3:00 is flexible, so I can still do that time. I've moved the invite to 3:00 pm tomorrow, let me know if that still works for you!

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-814384491, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7V2LD53UJ6OKLGNC2VDTHNOQBANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

@cindymerrill I'm glad we were able to get you into the dashboards! I've just granted you access to that DOMO dashboard. Please let me know if you're now able to view it, if you need anything else, or if this ticket is okay to close out.

cindymerrill commented 3 years ago

Thank you, Lauren! I can now see that DOMO dashboard.

Is there any training on using DOMO and Google Analytics that I could do so that I can learn how to use them both?

On Thu, Apr 8, 2021 at 7:00 AM Lauren Simpson @.***> wrote:

@cindymerrill https://github.com/cindymerrill I'm glad we were able to get you into the dashboards! I've just granted you access to that DOMO dashboard. Please let me know if you're now able to view it, if you need anything else, or if this ticket is okay to close out.

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-815848963, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7V2JONAQS2IPFDEQ5SLTHWZGDANCNFSM4X246TRA .

laurensimpson14 commented 3 years ago

A few options for GA:

Options for DOMO training:

cindymerrill commented 3 years ago

Thanks for the resources, Lauren! I will look into them. It's OK with me to close this ticket.

--Cindy

On Fri, Apr 9, 2021 at 6:14 AM Lauren Simpson @.***> wrote:

A few options for GA:

Options for DOMO training:

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/department-of-veterans-affairs/va.gov-team/issues/20168#issuecomment-816672819, or unsubscribe https://github.com/notifications/unsubscribe-auth/AQVM7VZUCO6TMQDJEOXTELLTH34RRANCNFSM4X246TRA .