search

dair-iitd / openie6

OpenIE6 system
GNU General Public License v3.0
119 stars 36 forks source link

Question about IL embeddings in your paper #11

Closed Aatlantise closed 3 years ago

Aatlantise commented 3 years ago

Hello,

openie6 is very interesting both in its performance and its approach to Open IE via grid labeling. Thank you for sharing your work.

In your paper, you only retain the embeddings of first word-piece for words that were broken into multiple word-pieces, instead of summing or using another technique to combine the word-piece embeddings.

Is there a particular reason why?

Thank you!

SaiKeshav commented 3 years ago

Thank you for your interest in our work. We experiment with two other strategies - picking the last word piece and averaging them. Both of them lead to similar performance. Hence, we decided to go ahead with using the first word-piece.

Aatlantise commented 2 years ago

Much thanks for your kind response :)

I have another question--in addition to the ILs, label embeddings are also generated and passed onto subsequent iterations. Are label embeddings one-hot vectors of length 6 (NONE, ARG1, ARG2, LOC, TIME, REL)? or is there a more complex way of computing them?