search

macanv / BERT-BiLSTM-CRF-NER

Tensorflow solution of NER task Using BiLSTM-CRF model with Google BERT Fine-tuning And private Server services
https://github.com/macanv/BERT-BiLSMT-CRF-NER
4.68k stars 1.25k forks source link

OOM happens when training #323

Closed moveon7 closed 4 years ago

moveon7 commented 4 years ago

i use 3 titan xp with 11.75G memory each, but OOM happens so it needs 24G at least?

moveon7 commented 4 years ago

and i have changed the batchsize to 32, max_length 128

macanv commented 4 years ago

You should further reduce the batch size config