opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.
https://opensearch.org/docs/latest/opensearch/index/
Apache License 2.0
9.74k stars 1.81k forks source link

[Search Query Categorization] Number and types of fields as part of response #11367

Open deshsidd opened 11 months ago

deshsidd commented 11 months ago

This task is part of the Search Query Categorization Meta task and the Query Visibility Project.

We need to use Telemetry metrics framework to capture the number and types of fields as part of the search query response.

This will be useful for analysis and to get more visibility regarding the search queries.

Phase 1: https://github.com/opensearch-project/OpenSearch/issues/10250 Phase 2 Meta issue : https://github.com/opensearch-project/OpenSearch/issues/11040 Query Visibility Roadmap : https://github.com/opensearch-project/OpenSearch/issues/11008

peternied commented 11 months ago

@deshsidd this issue doesn't have clear criteria - it looks like you are using this to track work planned or documented with another item can you flesh this out so its actionable by other contributors in this project?

Note; maybe this would be better captured in what is called a meta issue where this is part of a checklist in an issue with more context, or maybe this isn't an issue itself?

@macohen I think we've got a systemic problem with task tracking like this - maybe this is something you'd like to address.

msfroh commented 11 months ago

The big question that I have across these issues is "Why?"

I don't understand what the end-user experience is going to be once these metrics are available. How will these metrics be used?

So, on average, 90% of my queries return long fields and string fields. What am I going to do with that information? How does knowing that change my behavior?