4*V100 16G for bert SQuAD got OOM Problem

sogou / SogouMRCToolkit

This toolkit was designed for the fast and efficient development of modern machine comprehension models, including both published models and original prototypes.

Apache License 2.0

746 stars 164 forks source link

4*V100 16G for bert SQuAD got OOM Problem #36

Closed shuxiaobo closed 5 years ago

shuxiaobo commented 5 years ago

Hi, I tried to run run_bert_squad with bert base uncased model(uncased_L-12_H-768_A-12). But it give the OOM error. Is that normal?