search

o19s / quepid

Improve your Elasticsearch, OpenSearch, Solr, Vectara, Algolia and Custom Search search quality.
http://www.quepid.com
Apache License 2.0
284 stars 101 forks source link

Smarter Count on Ratings #530

Closed epugh closed 1 year ago

epugh commented 2 years ago

Is your feature request related to a problem? Please describe.

image

We added a red bubble for the count of the unrated docs for a query. It currently is Red, but honestly, if it's the last doc in the query set, and you only have 1, well, that isn't RED, that is like probably pretty minor (assuming ndcg). However, it counts more if you have CG, cause then it's equal issue to all the others. And 10 out of 10 unrated, well, that is deep RED.

Describe the solution you'd like I would like a model that tells me (based on my scorer selection) from 0 to 1, how much of an issue do I have in my ratings for a query, so I can communitcate to the relevance engineer how much they can trust their scores. This would ALSO be useful to priortize the rating work for category managers ;-)

Additional context

The background color for the dot could be considered to be on a yellow to red scale? https://www.color-hex.com/color-palette/81928

@nathancday for warnings, is yellow to red reaosnable? Is there something better we should use?

epugh commented 1 year ago

I've beat my head on font-awesome, and trying to get that bg color to change, with no luck. The palette I wanted is https://coolors.co/palette/f7b538-db7c26-d8572a-c32f27-780116... Going to close this as I can't figure it out.