D7/D10 search results differences

[adrianrylski]

          Overall this looks good.

Comparing D7 and D10, I think there might be places were we want to better understand the reasons for differences

Query	D7	D10
"Extended Producer Responsibility" (news)	D7 10 results	D10 5 results
morel mushrooms (events)	D7 no results	D10 3 results
nominee program (documents)	D7 800 results	D10 2,600 results
drivers abstract (web page)	D7 67 results	D10 21 results

Originally posted by @leeomara in https://github.com/ytgov/yukon-ca/issues/375#issuecomment-2197702638

[adrianrylski]

Query	D7	D10	Notes
"Extended Producer Responsibility" (news)	D7 10 results	D10 5 results	after adding missing fields to the D10 index we have even move results in D10
morel mushrooms (events)	D7 no results	D10 3 results	We are not searching strict string like in the previous request, and in the D10 we have matches for 'mushrooms'
nominee program (documents)	D7 800 results	D10 2,600 results	We have another PDF indexing logic and seems it is better than in D7
drivers abstract (web page)	D7 67 results	D10 21 results	We have more results after adding missing fields into the index

[leeomara]

Okay, here's what I now see.

Query	D7	D10	Notes
"Extended Producer Responsibility" (news)	10 results	~5~ 11 results	👍 Results look good
morel mushrooms (events)	no results	3 results	👍 makes sense
nominee program (documents)	800 results	~2,600~ 2,700 results	Okay
drivers abstract (web page)	67 results	~21~ 70 results	👍 Results look good

[leeomara]

I'm measuring search performance against the top 25 searches done for the last calendar year.

Here's a large, very spammy-looking table that provides links to search results across 3 sites:

• Existing Drupal site (D7). What we currently have/do
• Google {term} site:yukon.ca -open.yukon.ca -laws.yukon.ca -service.yukon.ca. A reference "good" result set
• Multidev (currently dev-64782-yukon-drupal-10). The new D10 version

This can be useful for comparisons.

Top 25 (2023)	Yukon.ca (D7)	Google	Multidev
jobs	jobs	jobs	jobs
nominee program	nominee program	nominee program	nominee program
vehicle registration	vehicle registration	vehicle registration	vehicle registration
covid	covid	covid	covid
job	job	job	job
staff directory	staff directory	staff directory	staff directory
directory	directory	directory	directory
mining tenure	mining tenure	mining tenure	mining tenure
drivers abstract	drivers abstract	drivers abstract	drivers abstract
vacation	vacation	vacation	vacation
insurance	insurance	insurance	insurance
map	map	map	map
mining	mining	mining	mining
abstract	abstract	abstract	abstract
legislation	legislation	legislation	legislation
whitehorse	whitehorse	whitehorse	whitehorse
medical travel	medical travel	medical travel	medical travel
maps	maps	maps	maps
immigration	immigration	immigration	immigration
school calendar	school calendar	school calendar	school calendar
budget	budget	budget	budget
dental	dental	dental	dental
pharmacare	pharmacare	pharmacare	pharmacare
camping	camping	camping	camping
careers	careers	careers	careers

(Edited 2024-07-04 to correct the Google links (they did not line up with search terms/labels)

[leeomara]

Based an analysis of the multidev search results from today, I have a list of which URLs Google returned in the top 10, that Drupal misses. It's another big table (176 rows), across the measured 25 searches.

[leeomara]

Based on a manual review of the differences in search results for "abstract", "budget", "careers" and "mining", I suspected that maybe Landing Page and Landing Page level 2 is not being included in search results.

Looking at the Search API index configuration in multidev confirm this.