EmilyAlsentzer / clinicalBERT

repository for Publicly Available Clinical BERT Embeddings
MIT License
658 stars 134 forks source link

About your Biobert pretrain model #11

Closed Billy-Zhoup closed 4 years ago

Billy-Zhoup commented 4 years ago

Hi Emily,

I still have one question.

For your model pretrained from Biobert, which version of Biobert you are using?

From biobert: https://github.com/naver/biobert-pretrained, there are 4 versions.

Thank you : )

EmilyAlsentzer commented 4 years ago

We used Pre-trained weight of BioBERT v1.0 (+PubMed 200K +PMC 270K)