Open wurenzhi opened 2 years ago
Hi. Thanks for reaching out. That's correct, the current method does not support datasets with abstentions. There is no straightforward workaround with the current implementation.
Thanks for raising this issue. This is definitely an interesting question for possible future extensions.
Hi, I have been trying to run the method on the datasets in the benchmark (https://github.com/JieyuZ2/wrench). It seems the method doesn't support datasets with abstention. Is this correct and is there a workaround? Thanks for your help!