Support Megatron-LM model for NER

uf-hobi-informatics-lab / ClinicalTransformerNER

a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms

MIT License

142 stars 28 forks source link

Closed bugface closed 2 years ago

bugface commented 3 years ago

follow up with https://github.com/huggingface/transformers/pull/10911 to include megatron-bert for NER (the PR has not been merged yet)

bugface commented 3 years ago

https://github.com/huggingface/transformers/issues/10321 - model parallel is not implemented yet so loading tensor model parallel model (multi ranks) is not available in HF

bugface commented 2 years ago

supported in commit 8bdc9f59e78c326cc50ca3a4c2722b3b2db539a3, will be merged into main soon