search

redreamality / RERE-relation-extraction

code for paper Revisiting the Negative Data of Distantly Supervised Relation Extraction
20 stars 3 forks source link

get all "0" in my own dataset #4

Closed hqp-hub closed 2 years ago

hqp-hub commented 2 years ago

Thanks for your incredible work ! Here's a problem I met: I reproduce RERE on NYT11-HRL , and it gives property indicators, although a bit lower than paper. But when i replaced the dataset with my own, it works out P=0/R=0/F1=0 in ee model , while rc model had property indicators(F1=94) Then i replaced the test set with train set ,rc model got a F1=100，but ee model still got P=0/R=0/F1=0 . And i use the same labeled data ( not same format) in TPlinker,and it gives about F1=65, which is property. All the modifiy is just about directory, and i checked my data format , I'm pretty sure that i have correct data format(still i will post some example below).

Could you please give me some advise to fix it? Thanks a lot

hqp-hub commented 2 years ago

oh , i just find the reason: my test set has a space behind every entity. I stuck in there for 1 week ,maybe i just need a person to talk (laugh), sorry to bother you ,have a nice day