search

mozilla / experimenter

A web application for managing user experiments for Mozilla Firefox.
https://experimenter.services.mozilla.com
Mozilla Public License 2.0
114 stars 179 forks source link

Ending a live experiment displays two pills (experiment end requested, and enrollment complete) #4687

Closed pdehaan closed 3 years ago

pdehaan commented 3 years ago

Re: https://stage.experimenter.nonprod.dataops.mozgcp.net/nimbus/pdehaan-default-firefoxen-prompt-retention-experiment

pdehaan_Default_Firefoxen_Prompt_Retention_Experiment___Experimenter

I ended the experiment and noticed we have two pills in the timeline.

In this specific case I'm not sure how relevant it is to tell me enrollment was completed since the experiment started Jan 15, so enrollment would have ended 15+7=Jan 22, which happens to be just over a month ago.

┆Issue is synchronized with this Jira Task ┆Issue Number: EXP-1001

data-sync-user commented 3 years ago

➤ Jody Heavener commented:

Hmm, [~amedinac@mozilla.com] I thought when we talked about about this we wanted both pills because it is possible to end an experiment before enrollment completes. I mean, in that case the absence of the "Enrollment Complete" badge would not be helpful, and something like "Ended before enrollment finished" would be better, but at any rate I did do this intentionally (not a bug) 🙈

data-sync-user commented 3 years ago

➤ Ana Medinac commented:

[~jheavener@mozilla.com]Yeah you're right this was by design. I haven't noticed much confusion while user testing, but I'll definitely keep an eye out for it, thanks Peter. In the meantime, I'll close the bug.