With the recent query optimizations, 7 should be fine for most if not all teams. This is the number one source of issues with batch exports, so the more we can bump the number the less users will be confused by missing events. The trade-off is load on CH.
Ultimately, we may move to setting up our own kafka consumers for ongoing exports, but for the time being we have to keep playing with this tradeoff.
Problem
With the recent query optimizations, 7 should be fine for most if not all teams. This is the number one source of issues with batch exports, so the more we can bump the number the less users will be confused by missing events. The trade-off is load on CH.
Ultimately, we may move to setting up our own kafka consumers for ongoing exports, but for the time being we have to keep playing with this tradeoff.
Changes
👉 Stay up-to-date with PostHog coding conventions for a smoother review.
Does this work well for both Cloud and self-hosted?
How did you test this code?