search

quickwit-oss / quickwit

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
https://quickwit.io
Other
8.32k stars 339 forks source link

Adding some kind of throttling on the janitor to prevent it from #5510

Closed fulmicoton closed 1 month ago

fulmicoton commented 1 month ago

hammering the metastore on airmail.

By default it is disabled. This feature can be enabled with "QW_MAX_SPLIT_DELETION_RATE_PER_SEC".

github-actions[bot] commented 1 month ago

On SSD:

Average search latency is 0.993x that of the reference (lower is better).
Ref run id: 3940, ref commit: 5e5b360ffba63e07ab9ff1b2735efb228d0c2520
Link

On GCS:

Average search latency is 0.992x that of the reference (lower is better).
Ref run id: 3941, ref commit: 5e5b360ffba63e07ab9ff1b2735efb228d0c2520
Link