Add support for "optimize_on_cpu"

utterworks / fast-bert

Super easy library for BERT based NLP models

Apache License 2.0

1.85k stars 342 forks source link

Add support for "optimize_on_cpu" #237

Open lefterav opened 4 years ago

lefterav commented 4 years ago

The last version of pytorch-pretrained-bert allows for using the "optimize_on_cpu" parameter for cases when there is not enough GPU RAM. It would be great if this option can be added at the trainer here.