UiL-OTS-labs / web-experiment-datastore

Other
0 stars 0 forks source link

Piloting state for experiments #41

Closed bbonf closed 2 years ago

bbonf commented 2 years ago

We currently have a 'Piloting' state for experiments, but it doesn't do anything. When your experiment is set to piloting:

Which means it's basically the same as leaving the experiment closed.

A better use of the piloting state would be if we let you start sessions and upload data, but later mark those sessions and data as pilot data. The basis for it already exists in ParticipantSession.experiment_state, but that's not currently used, and it is blocked by Experiment.is_open anyway.

tymees commented 2 years ago

It does actually do something, but not in this app. It's used by the utils library to allow access (if it's closed, the library redirects to a generic closed page).

The reason why we didn't allow data upload was to avoid confusion on the researchers side. However, I could live with marking it as pilot data (but it would also add more complexity to the group assignment logic, which is less ideal)

bbonf commented 2 years ago

Ok, thanks for bringing this up.

One thing I forgot to mention - not being able to create sessions when your experiment is set to piloting, also means that you cannot run an experiment locally: the server refuses to open a session and then the experiment can't start.

tymees commented 2 years ago

Well that is a problem then yes, so maybe the extra complexity is needed anyway then

bbonf commented 2 years ago

going to close this since we will fix it in #44