DA0-DA0 / dao-dao-ui

InterChain DAO tooling UI.
https://daodao.zone
27 stars 21 forks source link

Normalize each rater's retroactive compensation ratings before averaging #1719

Closed NoahSaso closed 5 months ago

NoahSaso commented 8 months ago

Raters in the retroactive compensation system may use different systems or scales (e.g. one may rate everyone independently 0-100 based on how well they match some given criteria, while another assigns percentages summing to 100% that describe the desired outcome distribution).

Right now, ratings are simply averaged, meaning that someone rating people higher (like when using an independent 0-100 system) has more impact on the outcome averages than someone rating people lower (like when using a sum to 100% system).

To account for this, ratings should be normalized within each rater's attribute ratings before all being averaged together. This is easily accomplished by dividing each rater's attribute ratings by the sum of their ratings for that attribute, to convert each rating into a value out of 100.

Thanks to mOde from Kleomedes for bringing this up!

NoahSaso commented 8 months ago

cc @elsehow, interesting we never uncovered this when using this in the DF, but i guess we had a pretty explicit criteria rating system

NoahSaso commented 5 months ago

Completed in fbb445fb33db5fedcba346e86bc2e5ad42f4a629