search

lukecq1231 / kim

Knowledge-based Inference Model
Apache License 2.0
55 stars 13 forks source link

Default parameters #2

Open tomwesolowski opened 6 years ago

tomwesolowski commented 6 years ago

Hello,

Why kb_composition is set to False and attention_lambda = 0 as default?

Thank you, Tomasz

tomwesolowski commented 6 years ago

We've run your code and got:

Final Result

Train cost 0.21672125 Train accuracy 0.9252539741193045 Valid cost 0.3237615 Valid accuracy 0.8847795163584637 Test cost 0.33407608 Test accuracy 0.8827361563517915

lukecq1231 commented 6 years ago

On the whole dataset, the model without kb_composition and attention_lambda usually achieves better result. However, when you only have low-resource training set, you need to use kb_composition and attention_lambda. There is variance in final result, and you will get better results when you run more times.