search

PostHog / posthog

🦔 PostHog provides open-source product analytics, session recording, feature flagging and A/B testing that you can self-host.
https://posthog.com
Other
20.79k stars 1.24k forks source link

Cannot change the "aggregating by" setting after A/B test is created #21056

Open flybayer opened 6 months ago

flybayer commented 6 months ago

How to reproduce

  1. Create A/B test with 'aggregating by' set to Organizations.
  2. Save it
  3. Change 'aggregating by' to users
  4. Save it
  5. Reload page
  6. See that 'aggregating by' is still set to Organizations

Environment

neilkakkar commented 6 months ago

Hey @flybayer , thanks for the report!

When you say 'aggregating by', you mean on the experiment metric, or the default participant type? Any screenshots you can share? The default participant type should get disabled for updates once you save the experiment 🤔