Backport b646861e770e6903538bb22dd551686aaeb7349d from #14874
What this PR does / why we need it:
We store chunkrefs for each task. As a result, the queue can grow and not fit into memory. This PR adds a new set of options to configure the queue to store the tasks in the filesystem. As a result, the queue only keeps the task metadata (e.g. results channel, time in queue, retires...) and the path to the task in the disk.
[ ] Title matches the required conventional commits format, see here
Note that Promtail is considered to be feature complete, and future development for logs collection will be in Grafana Alloy. As such, feat PRs are unlikely to be accepted unless a case can be made for the feature actually being a bug fix to existing behavior.
[ ] Changes that require user attention or interaction to upgrade are documented in docs/sources/setup/upgrade/_index.md
[ ] If the change is deprecating or removing a configuration option, update the deprecated-config.yaml and deleted-config.yaml files respectively in the tools/deprecated-config-checker directory. Example PR
Backport b646861e770e6903538bb22dd551686aaeb7349d from #14874
What this PR does / why we need it: We store chunkrefs for each task. As a result, the queue can grow and not fit into memory. This PR adds a new set of options to configure the queue to store the tasks in the filesystem. As a result, the queue only keeps the task metadata (e.g. results channel, time in queue, retires...) and the path to the task in the disk.
Special notes for your reviewer:
Checklist
CONTRIBUTING.mdguide (required)featPRs are unlikely to be accepted unless a case can be made for the feature actually being a bug fix to existing behavior.docs/sources/setup/upgrade/_index.mddeprecated-config.yamlanddeleted-config.yamlfiles respectively in thetools/deprecated-config-checkerdirectory. Example PR