search

uf-hobi-informatics-lab / ClinicalTransformerNER

a library for named entity recognition developed by UF HOBI NLP lab featuring SOTA algorithms
MIT License
145 stars 28 forks source link

alibi #32

Closed bugface closed 1 year ago

bugface commented 2 years ago

adapt alibi to BERT in NER

https://github.com/bigscience-workshop/Megatron-DeepSpeed/blob/4c13c617bdfb3bd419afd620bae87c74ae5aa79d/megatron/model/transformer.py#L116

bugface commented 1 year ago

https://github.com/ofirpress/attention_with_linear_biases/issues/5