[META] Multi-tenancy support in OpenSearch

[ansjcy]

Please describe the end goal of this project

Introduce and enable multi-tenancy as a first class citizen in OpenSearch by associating request traffic with specific users or workloads. This will allow better categorization, management, troubleshooting and analysis of subsets of traffic hitting an OpenSearch cluster.

We can start from the search queries use cases by attaching customized and rule-based labels and building a generic framework/solution for labeling, which can be later extend it to other workflow like indexing and bulk requests.

Note: We are not trying to achieve "full-multitenancy" in OpenSearch with this META issue :), but this could be a good first step towards that.

Supporting References

Related RFC

• https://github.com/opensearch-project/OpenSearch/issues/13341
• https://github.com/opensearch-project/OpenSearch/issues/14425
• https://github.com/opensearch-project/OpenSearch/issues/12740

Potential downstream consumers

• https://github.com/opensearch-project/OpenSearch/issues/11429
• https://github.com/opensearch-project/OpenSearch/issues/11173
• https://github.com/opensearch-project/OpenSearch/issues/10938
• https://github.com/opensearch-project/OpenSearch/issues/12084
• Slow logs, we haven't created an issue as mentioned in the RFC, but if we add the labels in the source field slow log will automagically have the labels.

Issues/PRs

Client-side labeling:

• [x] https://github.com/opensearch-project/OpenSearch/pull/13374

Rule-based labeling

• [ ] https://github.com/opensearch-project/OpenSearch/pull/14282
• [ ] https://github.com/opensearch-project/OpenSearch/pull/14388
• [ ] https://github.com/opensearch-project/security/issues/4402
• [ ] https://github.com/opensearch-project/security/pull/4403

POCs:

• This commit https://github.com/opensearch-project/OpenSearch/pull/13374/commits/3b6fd30dbb70452368cee3501e6889b4d9cc347a explores supporting customized labeling in search request headers and basic rule-based labeling service for search requests.
• https://github.com/opensearch-project/OpenSearch/pull/13713

Related component

Search

[andrross]

[Triage - attendees 1 2 3 4] @ansjcy Thanks for filing. Looking forward to seeing progress here.

[kaushalmahi12]

Hi @ansjcy thanks for opening this issue. I have an open PR for this for QSB use case(search workloads): https://github.com/opensearch-project/OpenSearch/pull/13713

[getsaurabh02]

this looks like a good plan. Thanks @ansjcy