Closed ChenLBs closed 12 months ago
@ChenLBs Thanks for your interest in our work and for asking insightful questions! We didn't actually use this file in our implementation. It represents an experimental approach we took to initialize the relation_embedding
. In the original paper, the relation_embedding
was initialized randomly, which already achieved the SOTA on both EM and EX at that time. However, a more refined method would be to convert these relations into natural language and use the T5 model's representations of these sentences as the initial embeddings.
I didn't see any calls, is this a technique you use to enhance performance?