humanprotocol / human-protocol

Human Protocol python/js/ts Monorepo with example
https://dashboard.humanprotocol.org
MIT License
23 stars 32 forks source link

Update to reputation algorithm to include data quality measures. #779

Open simulacrum6 opened 1 year ago

simulacrum6 commented 1 year ago

Is your feature request related to a problem? Please describe. The current iteration of the reputation algorithm is fairly simple and limited. It updates only Recording Oracles, not workers and does not account for the quality of the Job's results (i.e. data).

Describe the solution you'd like Design an updated algorithm / algorithms that takes data quality into account and updates workers and recording oracles alike.

Describe alternatives you've considered

Additional context

s7c commented 8 months ago

ACCEPTANCE CRITERIA:

  1. The algorithm's data quality metric should align with the platform's standards and user expectations.
  2. The algorithm should efficiently handle a growing number of workers and recording oracles without compromising system performance.
  3. Define and document the rationale behind the algorithm strategy and implementation.