Closed michelle-dooley closed 2 years ago
QA : VA Homepage | Ticket #41512 - Sitewide Search Dashboard (VA Homepage) | |
---|---|---|
Highlights | ||
Chart title | Assets | Pass / Fail |
Successful searches | Event Label = onsite-search-results-click/, Total events | 🟢 PASS |
Search funnel | Event Label = view_search_results/, Total events - page is www.va.gov/ | 🟢 PASS |
Search refinement rate | BigQuery metric (SUM(refinement ) / count(distinct concat(session_id , hit_number ))*1.0 |
🟢 PASS |
Task Completion | ||
Chart title | Assets | Pass / Fail |
Search click rate | BigQuery metric/ custom metric ((COUNT(DISTINCT CASE WHEN event_label = 'onsite-search-results-click' THEN CONCAT(session_id , hit_number ) END)/COUNT(DISTINCT CASE WHEN event_label = 'view_search_results' THEN CONCAT(session_id , hit_number ) END)) as search_click_rate) |
🟢 PASS |
Clicks by position | BigQuery metric - CASE WHEN search_results_position <= 2 THEN '1st or 2nd' WHEN search_results_position > 2 AND search_results_position <= 5 THEN '3rd - 5th' WHEN search_results_position > 5 THEN '6th or more' END as Click_rate_by_position, |
🟢 PASS |
Results clicked | BQMetric | see below comment |
Ease of use (search abandonment) | ||
Chart title | Assets | Pass / Fail |
Searched sessions | Sessions tab of report | Blocker |
Abandoned sessions | BigQuery metric | Blocker |
Search abandonment rate | BigQuery metric | Blocker |
Abandonment rates by most common search terms | BigQuery metric | Blocker |
Ease of use (search refinement) | ||
Chart title | Assets | Pass / Fail |
Refinement rate | BigQuery metric - SUM(refinement ) / count(distinct concat(session_id , hit_number )) |
🟢 PASS |
Search sessions by number of refinements | BigQuery metric sum(refinement) as total_refinements, ( CASE WHEN total_refinements = 0 then '0 refinements' WHEN total_refinements = 1 then '1 refinement' WHEN total_refinements = 2 then '2 refinements' WHEN total_refinements > 2 then '3 or more' END , Total sessions = COUNT(DISTINCT session_id ) |
🟢 PASS (total sessions) |
No results found | BigQuery metric (COUNT(DISTINCT CASE WHEN results_returned = 'No Search Results Returned' THEN CONCAT(session_id , hit_number ) END)/COUNT(DISTINCT CASE WHEN event_label = 'view_search_results' THEN CONCAT(session_id , hit_number ) END)) as No_results_found |
🟢 PASS |
Findability | ||
Chart title | Assets | Pass / Fail |
Top pages viewed before searching | BQMetric | see below comment |
Total search users | Users tab of report | 🟢 PASS |
Avg. searches per user | BigQuery metric - COUNT(DISTINCT CASE WHEN event_label = 'view_search_results' THEN CONCAT(session_id , hit_number ) END) / COUNT(DISTINCT user ) |
🟢 PASS |
Search users by device | Device tab of report | 🟢 PASS |
Top browsers types used to search | Browser tab of report | 🟢 PASS |
Adding slack convo for reference.
Task Completion | ||
---|---|---|
Chart title | Assets | Pass / Fail |
Results clicked | BigQuery metric - selectsearch_result_chosen_title as results_chosen, count(distinct concat(session_id, hit_number)) as total_eventsfrom vsp-analytics-and-insights.vsp_sites.vw_search_last_week where search_scope = 'All VA.gov' and event_label = 'onsite-search-results-click' and previous_page in ('www.va.gov/','www.va.gov/index') group by search_result_chosen_title order by total_events desc |
🟢 PASS |
Issue Description
This is an internal ticket for the data QA portion of the Sitewide Homepage Search.
Tasks
Acceptance Criteria
[ ] When data QA has been completed and signed off on for relaase.
How to configure this issue
product support
,analytics-insights
,operations
,service-design
,Console-Services
,tools-fe
)backend
,frontend
,devops
,design
,research
,product
,ia
,qa
,analytics
,contact center
,research
,accessibility
,content
)bug
,request
,discovery
,documentation
, etc.)