quickwit-oss / quickwit

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.
https://quickwit.io
Other
6.99k stars 291 forks source link

Add inflight memory counters for search #5184

Open fulmicoton opened 6 days ago

fulmicoton commented 6 days ago

Ideally we would like to have a decent picture of the memory usage between

trinity-1686a commented 1 day ago

this sounds a lot like quickwit_cache_in_cache_num_bytes

# HELP quickwit_cache_in_cache_num_bytes Number of bytes in cache by component
# TYPE quickwit_cache_in_cache_num_bytes gauge
quickwit_cache_in_cache_num_bytes{component_name="fastfields"} 0
quickwit_cache_in_cache_num_bytes{component_name="fd"} 0
quickwit_cache_in_cache_num_bytes{component_name="partial_request"} 0
quickwit_cache_in_cache_num_bytes{component_name="searcher_split"} 0
quickwit_cache_in_cache_num_bytes{component_name="shortlived"} 0
quickwit_cache_in_cache_num_bytes{component_name="splitfooter"} 0

is there more to add beside that?