wjn1996 / SpanProto

(Accepted By EMNLP2022 main long)SpanProto: A Two-stage Span-based Prototypical Network for Few-shot Named Entity Recognition
13 stars 2 forks source link

recall为1.0 #4

Open JayShJi opened 1 year ago

JayShJi commented 1 year ago

您好!

在运行您提供的脚本后,发现recall一直为1.0的情况,不知是否是下面这行代码的原因(这里将真实标签也拼进去,后面评测的时候泄露了)https://github.com/wjn1996/SpanProto/blob/f1e0acb8672f0bfcbb7c827c48b06b3e8ccb295a/models/span_proto.py#L588

此外,在将此处改成query_all_spans = query_predict_spans后,得到的结果和论文中相差较大,不知哪边出了问题。 FEW-NERD 5way-1shot: inter—— span_f1:0.5826 class_f1:0.4618 intra——span_f1:0.4606 class_f1:0.3548

fbotp commented 1 year ago

同样有这个疑问

Ryan-xsh commented 1 year ago

同样有这个疑问,有什么消息嘛