RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

tunib-ai / parallelformers

Parallelformers: An Efficient Model Parallelization Toolkit for Deployment

https://tunib-ai.github.io/parallelformers

Apache License 2.0

778 stars 61 forks source link

RuntimeError: "LayerNormKernelImpl" not implemented for 'Half' #28

Open samarthsarin opened 2 years ago

samarthsarin commented 2 years ago

I am trying to use Roberta NER and BERT NER uncased but for both of the models I am getting the following issues. Is it something which is still under development or anything wrong from my side?

Error: RuntimeError: "LayerNormKernelImpl" not implemented for 'Half'

hyunwoongko commented 2 years ago

Hi. please let me know the code you used.

hyunwoongko commented 2 years ago

normally, that error occurs when you use LayerNorm layer on CPU.