lzim / teampsd

Team PSD is using GitHub, R and RMarkdown as part of our free and open science workflow.
GNU General Public License v3.0
9 stars 23 forks source link

wk2 2024_apr_epic Bug: Sim UI TEST BREAK FIX Experiments Blue Bar in Sim UI - Team Experiments do not show up in Experiments Blue Bar in Shared World #3103

Closed lijenn closed 2 months ago

lijenn commented 3 months ago

In Break Fix, we found that there is one team experiment in "testqa_8march202401team" in the Facilitator Dashboard, but do not see the team experiment in the "testqa_8march202401shared" world in the "Select Experiment" dropdown in the "Experiments" blue bar:

In Team World:

image

In Shared World, it is missing "Team Experiements" text header and the experiment from Team World:

image

It should look something like this since experiments in _team worlds should be accessible in their respective _shared worlds under Team Experiments, like how we see this in PROD:

image
jamesmrollins commented 3 months ago

@tejaspesquare Can you please update us on this issue?

tejaspesquare commented 3 months ago

@jamesmrollins - This is tracking in #3102

ljmoody commented 3 months ago

Hello @tejaspesquare (card 3102 mentioned above is about PROD Team Experiments not showing). This card is about Test Break Fix Team Experiments not showing up in the experiments blue bar in a _shared world. Today we tested and the issue still exists. This is what I see in a _team world I created (which has 3 experiments I saved): image

Here is what it it looks like in the Play environment: image

In the _shared world, I see no experiments - and therefore can't go into the Play environment: image

jamesmrollins commented 3 months ago

3/13 Demo Call

tejaspesquare commented 3 months ago

@jamesmrollins - We are still working on this & doing troubleshoot.

ljmoody commented 3 months ago

Hello @tejaspesquare, Jenn and I tested this today (in TEST BREAK FIX) - the issue still exists. We are not seeing a list of all Team Experiments in the Experiments blue bar drop-down. Here is the view of the shared team experiment - but there are no team experiments shown: image

The team experiments are the highlighted ones below - and should be included in the drop-down highlighted in the screenshot above. image

jamesmrollins commented 3 months ago

3/20 Stand Up

tejaspesquare commented 3 months ago

@lijenn - Results on Test Breakfix - under my login 3 experiments it showing for _team image

Out of 3, 2 are from MM & 1 for CC image

image

On Runner screen MM Experiments image

CC Experiment image

Add one more experiment (MM) 3MM & 1 CC image

Added experiment using _shared world & it separated out with Team Experiments (MM model) image

tejaspesquare commented 3 months ago

@ljmoody , @lijenn - I have added myself as a facilitator in a team (123_james_test_shared) as you mentioned in a screenshot & did run experiments. I could see it is listed as shared experiments & Team experiments.

Dashboard - _Shared image

Runner Screen image

Dashboard - _Team image

Are these results expected one or still I'm missing any steps to reproduce issue.

ljmoody commented 3 months ago

@lijenn, I tested this in break-fix today after our testing (& training) session together. Below are the results which I think validate the correct functioning of the Experiments Blue Bar in Sim UI. Please review the testing below and close this card if you agree.

All data files associated with 12mar_moodyteam2_team are: image

In the _team world:

In the _shared world:

fyi: @tejaspesquare @jamesmrollins

lijenn commented 3 months ago

@ljmoody Thanks for testing the above! Do you see all 3 MM and the 1 CC Team experiments in the Experiment dropdown in the Facilitator/Admin Dashboard here:

image

If you selected all 4 experiments in each "Select Experiment" dropdown, it will tell you the module it's from. For example:

image
ljmoody commented 3 months ago

@lijenn A-HA!! Yes, the DIALS tell. Took me a minute. Cool! Another link/connection made. And also - no, I didn't see all 4 in that view, just the 3 MM experiments for _team world. Should I/we see all 4 listed as experiments under the _team world? image

lijenn commented 3 months ago

@ljmoody You should see all 4, if all 4 (regardless of module) was created in the team world. Can you confirm? I can't get access to that team.

tejaspesquare commented 3 months ago

@ljmoody , @lijenn - Just FYI As discussed in standup meeting, on Dashboard Team specific (regardless of module) experiments listed on drop-down, while on runner screen (Experiments blue bar) will show _Team & _Shared experiments but only specific to module type. i.e. CC, MM

TEST-Breakfix - here highlighted item in for CC model which is not listed on runner screen as expected. image

Runner screen - Above highlighted CC experiment not listed, only MM experiments are shown as expected image

ljmoody commented 3 months ago

@lijenn & @tejaspesquare -

image

@ljmoody Thanks for testing the above! Do you see all 3 MM and the 1 CC Team experiments in the Experiment dropdown in the Facilitator/Admin Dashboard here: image

If you selected all 4 experiments in each "Select Experiment" dropdown, it will tell you the module it's from. For example: image

jamesmrollins commented 3 months ago

3/25 Stand UP

tejaspesquare commented 3 months ago

@ljmoody - We have verified count issue you mentioned on Test Break-fix related to team experiments. As per investigation results are correct. On Dashboard team (_shared or _team) specific experiments are shown in the drop-down while on home screen (Experiment Maintenance block) both _team & _shared experiments combinedly showed.

Dashboard _team experiments image

Dashboard _shared experiments image

Home screen : _team + _shared experiments appear as per business logic. image

lijenn commented 3 months ago

@tejaspesquare I tried to create a new team to test this. I was unable to upload a team data file in Break Fix: image

I am also unable to access the 12mar_moodyteam2 worlds, despite being a facilitator: image

tejaspesquare commented 3 months ago

@lijenn - We will check for file upload issue on Test Breakfix.
Regarding another issue you mentioned for '12mar_moodyteam2' worlds you are not a member as per Epicenter.

image

ljmoody commented 3 months ago

@lijenn , I've added you (praxis account, facilitator role) to the _shared and _team worlds. Can you see them now?

image image

ljmoody commented 2 months ago

I've tested this and believe it's functioning properly, given the rules of where and how teams vs shared experiments show.

@lijenn, will you please test to see if

lijenn commented 2 months ago
  • [ ] you can access the 12mar_moodyteam2 worlds (your Praxis account is set as facilitator in both)

I do not see the 12mar_moodyteam2 worlds.

lijenn commented 2 months ago

Discussed Sim UI Stand Up 04/04/2024:

tejaspesquare commented 2 months ago

@lijenn - It was a permission issue on Test Break-fix. I have added you as a user with 'praxisanalytix' ID & given facilitator role.

image

lijenn commented 2 months ago

@lijenn confirmed that the role issue, world access issue, and list of experiments in the 12mar_moodyteam2 worlds are working properly. Closing this card. Thanks!