elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.57k stars 8.09k forks source link

Performance test the alternative task claimer that uses client-side updates w/ mget to prune stale docs #181326

Open mikecote opened 4 months ago

mikecote commented 4 months ago

Part of https://github.com/elastic/kibana/issues/155770

Feature Description

Change the task manager task claiming algorithm to use a _search to retrieve candidate tasks, a _mget to prune the docs whose version number doesn't match, and then a _bulk to claim the tasks. This will increase the background task capacity in Serverless.

Business Value

Increased background task capacity, reducing the COGS for running alerting rules and actions, and providing a lower MTTD/MTTR.

Definition of Done

elasticmachine commented 4 months ago

Pinging @elastic/response-ops (Team:ResponseOps)