Open gimseng opened 3 years ago
Hi, I'd like to use BERT-NER for inference, mainly to recognise ORG. I have been able to do so with CPU, now I'd like to know two things:
Would GPU speed up inference ?
Does BERT-NER automatically use CPU? I tried it on Google Colab and I don't see any changes in inference time. Please advice how, thanks !
Hi, I'd like to use BERT-NER for inference, mainly to recognise ORG. I have been able to do so with CPU, now I'd like to know two things:
Would GPU speed up inference ?
Does BERT-NER automatically use CPU? I tried it on Google Colab and I don't see any changes in inference time. Please advice how, thanks !