Question about the local window size

allenai / PRIMER

The official code for PRIMERA: Pyramid-based Masked Sentence Pre-training for Multi-document Summarization

Apache License 2.0

150 stars 31 forks source link

Question about the local window size #10

Open rigggby opened 2 years ago

rigggby commented 2 years ago

Hi, thanks for sharing your great work. I have a question about the local window size of the LED model, as far as I know, it is 1024 in the Longformer paper as well as the huggingface version, however, you mention that it is 512 in your paper, did you resize it or is there anything that I misunderstand?

Wendy-Xiao commented 2 years ago

Hi,

I directly use the default window size of the LED model provided on the original github, which is 512.