search

thunlp / FewRel

A Large-Scale Few-Shot Relation Extraction Dataset
https://thunlp.github.io/fewrel.html
MIT License
731 stars 165 forks source link

Unable to replicate gnn result #61

Closed nanjiangwill closed 2 years ago

nanjiangwill commented 3 years ago

Hi, I was unable to replicate gnn + cnn result on any n way k shot experiment, and the accuracy was always 1/N, what might be the problem.

Sometimes, the experiment goes well when I change the seed

gaotianyu1350 commented 3 years ago

Hi,

We also found that GNN training could be quite unstable sometimes. Making sure you use the latest pytorch version, changing random seeds or trying larger batch sizes may help.