opensearch-project / OpenSearch

🔎 Open source distributed and RESTful search engine.
https://opensearch.org/docs/latest/opensearch/index/
Apache License 2.0
9.68k stars 1.79k forks source link

[Remote Store] After remote store GA, introduce common backpressure interface for indexing, segrep and remote backpressure #7623

Open ashking94 opened 1 year ago

ashking94 commented 1 year ago

Is your feature request related to a problem? Please describe. After remote store GA, introduce common backpressure interface for segrep and remote backpressure

Describe the solution you'd like We will make appropriate changes in TransportShardBulkAction class.

Describe alternatives you've considered NA

Additional context NA

Bukhtawar commented 1 year ago

I would love to see a common backpressure flow for indexing sync path and converge indexing backpressure/shard indexing prressure and remote store backpressure such that they can all independently provide a natural backpressure mechanism as request flows through coordinator -> primary -> remote-store.