search

kamalkraj / BERT-NER-TF

Named Entity Recognition with BERT using TensorFlow 2.0
Apache License 2.0
212 stars 71 forks source link

Support for ALBERT #2

Closed shiju80 closed 4 years ago

shiju80 commented 4 years ago

Hi Kamal, Is it possible to load Albert Tf1.0 model found here - https://github.com/google-research/google-research/tree/master/albert for NER training.

kamalkraj commented 4 years ago

Hi @shiju80, I just finished converting Albert model to TF 2.0 and tested with TF hub weights. Both produce identical results. Will release all the task training, including NER. with TF 2.0 soon.

shiju80 commented 4 years ago

Thanks @kamalkraj , looking forward to trying it out.

kamalkraj commented 4 years ago

@shiju80 ALBERT is not suitable for NER task. All the models they released are uncased https://github.com/kamalkraj/ALBERT-TF2.0

shiju80 commented 4 years ago

oh ok Thanks @kamalkraj