search

quickwit-oss / quickwit

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
https://quickwit.io
Other
6.99k stars 291 forks source link

More aggressive shard scale up settings. #5156

Closed fulmicoton closed 1 week ago

fulmicoton commented 1 week ago

1 shard every 2 seconds vs 5 seconds before.

github-actions[bot] commented 1 week ago

On SSD:

Average search latency is 1.0x that of the reference (lower is better).
Ref run id: 2293, ref commit: 0a77e3cc57d6fb40b36617a9af8faf128e1a2a64
Link

On GCS:

Average search latency is 1.05x that of the reference (lower is better).
Ref run id: 2294, ref commit: 0a77e3cc57d6fb40b36617a9af8faf128e1a2a64
Link

guilload commented 1 week ago

FYI, I had already increased the limit from 5 shards/minute to 12.