elastic / elasticsearch

Free and Open Source, Distributed, RESTful Search Engine
https://www.elastic.co/products/elasticsearch
Other
69.69k stars 24.66k forks source link

[Learn to Rank] LTR explain should use shapley feature importance values if possible #113211

Open benwtrent opened 1 week ago

benwtrent commented 1 week ago

Description

XGBoost and other types of models can actually provide information indicating the individual branch and feature importance in the tree leaves.

Inference in Elasticsearch can utilize this information to calculate shapley importance of each feature during inference. This should be done if possible as it provides valuable insights into what features were actually important for the given prediction, not just what features were used.

elasticsearchmachine commented 1 week ago

Pinging @elastic/ml-core (Team:ML)

elasticsearchmachine commented 1 week ago

Pinging @elastic/es-search-relevance (Team:Search Relevance)