PostHog / posthog

🦔 PostHog provides open-source product analytics, session recording, feature flagging and A/B testing that you can self-host.
https://posthog.com
Other
21.62k stars 1.29k forks source link

Bug: Identifying incorrect users in trends #5122

Closed joethreepwood closed 2 years ago

joethreepwood commented 3 years ago

Bug description

Stumbled across this in an attempt to identify and research which users are using which data warehouse plug-ins.

I started with this chart simply:: Plugin enabled total count broken down by name, displayed as a pie chart.

When I clicked through to the size of a segment to inspect the users, I started seeing odd numbers. Then I realised that no matter which segment I clicked on, I was seeing the same 18 users identified repeatedly.

Discussed with @neilkakkar who created an alternate chart to investigate the data. I clicked through to the segments and saw the same 18 users identified, over and over again.

Expected behavior

I expected to see a pie chart breaking down plugin use by name, then to be able to click through to a segment and inspect the correct users for that plugin.

How to reproduce

  1. Visit one of the charts linked above
  2. Click a segment to inspect users
  3. Click another segment after

Environment

Additional context

I won't share a screenshot here as it includes personal information, but have supplied them to @neilkakkar (who was kind enough to help) and can share on Slack if needed.

Thank you for your bug report – we love squashing them!

joethreepwood commented 3 years ago

May be worth adding: I had this bug in Brave, on Mac. I then retested it in Chrome, on Mac, after logging out and in again. Same results.

paolodamico commented 2 years ago

This was originally assigned to Core Experience but the scope seems quite related to Core Analytics, @liyiy are you okay picking this up? Looks like you assigned yourself, but feel free to tag the secondary on call too.

liyiy commented 2 years ago

I actually just took another look at this and the users seem to be different now! Looks like it might've been resolved by something else, happy to close this unless you spot something obviously wrong still