[FEATURE] Improve ds algorithm to use worker's history error matrix info

Toloka / crowd-kit

Control the quality of your labeled data with the Python tools you already know.

https://crowd-kit.readthedocs.io/

Other

213 stars 16 forks source link

[FEATURE] Improve ds algorithm to use worker's history error matrix info #112

Closed shenxiangzhuang closed 3 months ago

shenxiangzhuang commented 3 months ago

Problem description

The current implementation of ds algorithm doesn't take worker's history error matrix into consideration, which is a useful priori information that can help the truth inference process.

Feature description

Improve ds algorithm to use worker's history error matrix info

Potential alternatives

No response

Papers connected with feature