search

quickwit-oss / quickwit

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
https://quickwit.io
Other
6.99k stars 291 forks source link

Apply rate limiting before validating docs #5170

Closed guilload closed 1 week ago

guilload commented 1 week ago

Description

Check WAL capacity and apply rate limiting before validating docs.

How was this PR tested?

Added unit tests

github-actions[bot] commented 1 week ago

On SSD:

Average search latency is 1.0x that of the reference (lower is better).
Ref run id: 2337, ref commit: 4ade7b5ec59685fc508c1834f2e23b5ca7b5afbe
Link

On GCS:

Average search latency is 1.03x that of the reference (lower is better).
Ref run id: 2339, ref commit: 4ade7b5ec59685fc508c1834f2e23b5ca7b5afbe
Link