Answering performance of Longformer-base on the HotpotQA dev set

allenai / longformer

Longformer: The Long-Document Transformer

https://arxiv.org/abs/2004.05150

Apache License 2.0

2k stars 268 forks source link

Answering performance of Longformer-base on the HotpotQA dev set #247

Closed zycdev closed 1 year ago

zycdev commented 1 year ago

Hi,

I only found Longformer-base's joint F1 on the HopotQA dev set from the paper, and I would like to know if my reproduction results (Ans EM = 61.38, Ans F1 = 75.18) are expected. Could you provide some more specific metrics?

Thank you!