The "Experiment Bugzilla Ticket" isn't created for experiments on the new stage website

mozilla / experimenter

A web application for managing user experiments for Mozilla Firefox.

https://experimenter.services.mozilla.com

Mozilla Public License 2.0

121 stars 186 forks source link

The "Experiment Bugzilla Ticket" isn't created for experiments on the new stage website #1201

Closed Softvision-RemusDranca closed 5 years ago

Softvision-RemusDranca commented 5 years ago

[Affected versions]:

Firefox Release 66.0.3 and above
Chrome 74.0. and up

[Affected Platforms]:

All Windows
All Mac
All Linux

[Prerequisites]:

Have an Draft experiment created on the "https://stage.experimenter.nonprod.dataops.mozgcp.net/" website.
You are logged in your LDAP account.

[Steps to reproduce]:

Open the browser with the profile from prerequisites and navigate to "https://stage.experimenter.nonprod.dataops.mozgcp.net/".
Open the experiment from prerequisites and click the "Ready for Sign-Off" button.
Refresh the page and observe the "Tickets" section under the experiment's title.

[Expected result]:

The "Experiment Bugzilla Ticket" is displayed in front of the "Data Science Bugzilla Ticket".

[Actual result]:

Only the existing tickets are displayed.

[Notes]:

Attached is a screen recording of the issue:

jaredlockhart commented 5 years ago

This was caused by a regression we introduced when we renamed everything from 'study' to 'experiment' and is fixed in https://github.com/mozilla/experimenter/issues/1214

Softvision-AndreeaCupsa commented 5 years ago

This issue is only partially fixed as it is still fully reproducible with add-on experiments in the "Signed Off" state which have only the required fields from the “Overview” section filled.

And it is intermittently reproducible with:

Pref experiments which have only the required fields from the “Overview” section filled
Add-on experiments which have the required population area filled
Experiments which have all the fields from all sections filled
A previously archived experiment in the "Draft" state

jaredlockhart commented 5 years ago

Figured this out, stage and dev were sharing a redis instance and consuming one anothers tasks so they were intermittently failing regardless of which data was present.

Softvision-RemusDranca commented 5 years ago

I have verified this issue and is no longer reproducible on Experimenter stage "https://stage.experimenter.nonprod.dataops.mozgcp.net" website. Tested on Windows 10x64, Mac 10.14 and Arch Linux 4.16.6 x64.