Search: Add Ranking Evaluation Integration

[gibrown]

We've had a few requests about how to evaluate search rankings and improve the search algorithm for individual sites. Having a standard, defined way to help folks customize their search would help them get better relevancy.

This project looks like it could be good to integrate with but needs some evaluation: https://sease.io/2018/07/rated-ranking-evaluator.html

The tools there look a lot like what I used when evaluating queries on the wp.org plugin directory.

Some hooks we would need to figure out:

• how to get the base query from a site (I guess capture the search request)
• how to hook up to our query api for running the searches
• (eventually) how to pull in search analytics data to the tool

A very basic use case though is just testing and documentation of how to use the tools together with maybe some minor code changes to make it easier to get the search query info (maybe the existing integration with debug bar is sufficient though).

[gibrown]

Maybe combine this with https://opensourceconnections.com/blog/2018/05/04/reflective-relevance-testing/ in order to generate an initial list of potentially "correct" answers for a site. We have a lot of data about popular posts that we could draw on.

[stale[bot]]

This issue has been marked as stale. This happened because:

• It has been inactive in the past 6 months.
• It hasn’t been labeled `[Pri] Blocker`, `[Pri] High`.

No further action is needed. But it's worth checking if this ticket has clear reproduction steps and it is still reproducible. Feel free to close this issue if you think it's not valid anymore — if you do, please add a brief explanation.