search

LearnersGuild / game-prototype

Lightweight, minimal implementation of game mechanics for rapid experimentation and prototyping.
0 stars 0 forks source link

Expand review accuracy/bias stat #120

Closed tannerwelsh closed 7 years ago

tannerwelsh commented 8 years ago

Benefits

What are the benefits of this change, and whom do they impact?

Description

Describe the change, and provide any needed context.

Instead of just measuring review accuracy/bias between learners' internal reviews, also measure their accuracy/bias when doing external reviews.

Note: the names below could use some work.

Changes

Expand two review stats to include external reviews: Review Accuracy and Review Bias for each review dimension: quality and completeness.

Review Accuracy [External]

It is calculated by running the following algorithm:

for each external review of player
  find mean of all external completeness||quality reviews for project
  set result to avgExternalReview
  subtract avgExternalReview from player completeness||quality review
  set result to projectReviewBias
  subtract absolute value of projectReviewBias from 100
  set result to projectReviewAccuracy
find mean of all projectReviewAccuracy scores

Review Bias [External]

It is calculated by running the following algorithm:

for each external review of player
  find mean of all external completeness||quality reviews for project
  set result to avgExternalReview
  subtract avgExternalReview from player completeness||quality review
  set result to projectReviewBias
find mean of all projectReviewBias scores
tannerwelsh commented 7 years ago

Moved to Clubhouse.