SCHENLIU / longformer-chinese

chinese version of longformer
110 stars 15 forks source link

question about tokenizer #18

Open lucDoom opened 6 months ago

lucDoom commented 6 months ago

Hi, I wonder if this longformer was trained with tokenizer ----- google-bert/bert-base-chinese? Thx for ur help,sir!