BatsResearch / amcl

Adversarial Multi Class Labeling
5 stars 1 forks source link

support for datasets with abstention? #2

Open wurenzhi opened 2 years ago

wurenzhi commented 2 years ago

Hi, I have been trying to run the method on the datasets in the benchmark (https://github.com/JieyuZ2/wrench). It seems the method doesn't support datasets with abstention. Is this correct and is there a workaround? Thanks for your help!

yokola95 commented 2 years ago

Hi. Thanks for reaching out. That's correct, the current method does not support datasets with abstentions. There is no straightforward workaround with the current implementation.

Thanks for raising this issue. This is definitely an interesting question for possible future extensions.