department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
284 stars 206 forks source link

Facility Locators Edge Case Dashboard: Corrective Tasks #76514

Open johnny-jesensky-adhoc opened 9 months ago

johnny-jesensky-adhoc commented 9 months ago

Description:

Need to review and QC the Facility Locators edge case dashboard that was delivered a few weeks ago. We received some feedback that there is missing data in a few different spots, making it unusable in its current form.


Tasks

The fixes for this dashboard can be broken up into three different cards that will need to be updated.

Task 1: Update & Add Tracking for 'What type of facilities are people searching for?` Card This card isn't currently capturing expected behavior. We need it track the percentage of searches based on the Facility Type required entry field.

What we'll need to likely do here.

image.png

Task 2: Update click-through metrics to ensure vba and nca is being captured. This task is to ensure click-through rates are being calculated on a granular level. Right now, vba and nca are likely being bucketed into an 'other' category, which we'll need to address

"Click through is itself a desirable metric but the graph seems to only capture the click throughs to modernized VAMC and Vet Center pages and does not include data for two facility types, which both follow the pattern of https://www.va.gov/find-locations/facility/ facility id

VA benefit facilities have a facility id which begins with vba, such as VA Regional Benefit Satellite Office at Thomas S. Foley U.S. Courthouse VA cemeteries have a facility id which begins with nca, such as Cheltenham Veterans Cemetery"

Task 3: Fix/Update Refinement Rate Calculation This task is to understand how and why the refinement rate is so showing as so low. We have the query in BigQuery that's assigning hits as either a 0, or 1. We need to determine what changes we might need to make on this front.

CASE WHEN (CASE WHEN event_label = 'view_search_results' THEN TRIM(search_results_arr[SAFE_OFFSET(3)]) END) != LEAD(CASE WHEN event_label = 'view_search_results' THEN TRIM(search_results_arr[SAFE_OFFSET(3)]) END,1) OVER (PARTITION BY a.session_id ORDER BY hitNumber ASC) THEN 1 ELSE 0 END as refinement,


Acceptance Criteria

johnny-jesensky-adhoc commented 9 months ago

Reach out to Michelle letting them know that FE can enable the no results found tracking.

johnny-jesensky-adhoc commented 8 months ago

Per refinement, JJ to break this out into three separate tasks -- look to refine separately.