How many unlabeled data are needed to pretrain knowbert?

allenai / kb

KnowBert -- Knowledge Enhanced Contextual Word Representations

Apache License 2.0

370 stars 50 forks source link

How many unlabeled data are needed to pretrain knowbert? #28

Open PhantomGrapes opened 3 years ago

PhantomGrapes commented 3 years ago

Hello, I tried to pretrain a new knowbert in another domain. I would like to know how many unlabeled data are needed? (this number was not specified in paper)

Thanks.