openheartmind / WISDOM

An open science framework for estimating the relative value of community contributions through pairwise comparison reviews, so that contributors can be directly recognised and rewarded for their contributions
https://www.openheartmind.org/research
Other
7 stars 0 forks source link

Contribution information importing differently for different reviewers #10

Open CooperSmout opened 8 months ago

CooperSmout commented 8 months ago

During our pilot test in #9 we discovered that the contributions in 'REVIEW' tab were showing up differently for each person, e.g. with a different title and/or description for the same row. Perhaps related to the way 'pairings' tab is using a function to create random numbers and then imported to the 'REVIEW' tab using INDIRECT function.

Version notes:

CooperSmout commented 8 months ago

Seems there are several design options: (1) randomise order within REVIEWS tab itself. (2) randomise order in separate tab and pull into REVIEWS tab (3)

Option 2 is better for administrators as it means they don't need to create a new random array when creating a new prototype, but given the bug here think it's safer to proceed with fixed random numbers (using Paste Special -> Values only) and take another look at the automation with the next prototype version.

I'm going to fix the number of event contributions at 30 and then fix the random array.