bboreham
commented
3 years ago This is in production at Weave Cloud now.
One glitch: if you forget to set --app.collector-addr that should be a fatal error so the administrator can spot the problem earlier.
Fixes #3783
Collectors hold recent reports in memory; when querier needs 'live' data, it fetches it from collectors instead of from the long-term store.
This means queriers get more up-to-date data, by the store-frequency collector was using (e.g. 2 seconds), and we can slow down that frequency to spend less on S3/DynamoDB.
Included in this change: multitenant collector now always saves async - removed support for saving all reports immediately to store.