Currently pairwise comparisons are submitted and saved to the database as a set of pairs (the equivalent of a MUSHRA trial). Therefore, each participants has to rate all pairs. However, if we want to increase the number of stimuli in a comparison, requiring a single participant to rate all pairs will quickly be come infeasible. We have to instead save each individual comparison to the database and allow participants to contribute an arbitrarily-sized subset of the total set of pairs.
This will require many changes throughout the code base.
Currently pairwise comparisons are submitted and saved to the database as a set of pairs (the equivalent of a MUSHRA trial). Therefore, each participants has to rate all pairs. However, if we want to increase the number of stimuli in a comparison, requiring a single participant to rate all pairs will quickly be come infeasible. We have to instead save each individual comparison to the database and allow participants to contribute an arbitrarily-sized subset of the total set of pairs.
This will require many changes throughout the code base.