grafana / loki

Like Prometheus, but for logs.
https://grafana.com/loki
GNU Affero General Public License v3.0
23.97k stars 3.46k forks source link

feat(blooms): Merge all resulting metas into a single one #15020

Closed salvacorts closed 1 day ago

salvacorts commented 2 days ago

What this PR does / why we need it:

We often en up with thousands of metas per tenant-table tuple (as many as tasks). This PR merges all the resulting metas into a single (bigger one) that aggregates all the up to date metas for the tenant table once all tasks have completed. The unaggregated metas are deleted (blocks are kept as these are now referenced by the new merged meta).

Checklist

salvacorts commented 1 day ago

Closing this one as we would miscompute gaps. Supporting this would require adding some complexity that we think is not worth at the time.