search

PostHog / posthog

🦔 PostHog provides open-source product analytics, session recording, feature flagging and A/B testing that you can self-host.
https://posthog.com
Other
21.62k stars 1.29k forks source link

Difference between funnel trends & funnel steps result across the same time period #4369

Closed kpthatsme closed 3 years ago

kpthatsme commented 3 years ago

Bug description

I'm not sure if this is a bug or if there's something with either this funnel query or the underlying data that I'm missing.

Ran this by @EDsCODE once and he agreed something looked off but we haven't come to a definitive example.

Expected behavior

Look at this funnel, using the funnel trends view.

You can see the last 2 data points, we have pretty low conversion rates.

Now let's look at the same funnel, but as a Steps of the last 7day – you get a much larger conversion rate.

Similarly, looking at the funnel trends chart over 7 day we get similarly different results from the steps over the same time periods.

How to reproduce

  1. View the funnel trends and the funnel steps linked above
  2. Observe pretty different conversion rates on the trends chart for each weekly datapoint versus the steps over the same time period

Environment

Additional context

Thank you for your bug report – we love squashing them!

timgl commented 3 years ago

@buwilliams weren't you already looking at this?

buwilliams commented 3 years ago

Yes, PR is on its way. #4419