crownpku / Information-Extraction-Chinese

Chinese Named Entity Recognition with IDCNN/biLSTM+CRF, and Relation Extraction with biGRU+2ATT 中文实体识别与关系提取
2.22k stars 813 forks source link

NER iob转成iobes之后KeyError #111

Open lishengye opened 5 years ago

lishengye commented 5 years ago

NER更换了data数据集之后,训练bilstm,抛出KeyError。 观察数据发现正好有一个实体类型都是两个字,而读了代码发现如果是B-XX后面跟I-XX再跟O的话,在转成iobes时会把I-XX弄成E-XX,导致在loader.py第110行抛了KeyError。看样子应该是tag_to_id这个dict找不到I-XX这个key,请问改如何解决?