grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
24k stars 3.46k forks source link

feat(blooms): Prefetch bloom blocks as soon as they are built #15050

Closed salvacorts closed 2 days ago

salvacorts commented 3 days ago

What this PR does / why we need it:

This PR adds a new RPC endpoint to the bloom gateway service. Builders pass the blocks they built to the gateway and it download them async. That way blocks will likely be already present in the gateways at query-time.

This can be enabled setting the per-tenant bloom_prefetch_blocks limit to true.

We are also increasing the gateway download queue from 10K to 100K.

Checklist