zihangdai / xlnet

XLNet: Generalized Autoregressive Pretraining for Language Understanding
Apache License 2.0
6.16k stars 1.18k forks source link

The relation of reuse_len and mem_len? #272

Closed guotong1988 closed 3 years ago

guotong1988 commented 3 years ago

image

I used to guess reuse_len and mem_len should be same.

guotong1988 commented 3 years ago

https://github.com/zihangdai/xlnet/issues/59