search

uf-hobi-informatics-lab / ClinicalTransformerNER

a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms
MIT License
145 stars 28 forks source link

BERT-large (MIMIC)? #15

Closed drussellmrichie closed 3 years ago

drussellmrichie commented 3 years ago

Hi, thank you for releasing this excellent resource. I'm wondering if you have released BERT-Large (MIMIC)? The model here only has 12 layers so must be BERT-base? Am I missing something?

bugface commented 3 years ago

All mimic models are pretrained with the base version of the transformer models. We do not have bert-large pretrained on MIMIC because of limited computing resources.

drussellmrichie commented 3 years ago

Oops, sorry, I got confused between your paper and this one. My mistake!