Hey everyone,
I want to train the model on CPU to use the pytorch post dynamic quantization afterwards. and then run the eval.py on cuda to improve the inference.
I am having trouble running the model only on cpu.
Does any one have suggestions how I can run it only on the cpu? And did anyone quantizise the model already?
Hey everyone, I want to train the model on CPU to use the pytorch post dynamic quantization afterwards. and then run the eval.py on cuda to improve the inference.
I am having trouble running the model only on cpu.
Does any one have suggestions how I can run it only on the cpu? And did anyone quantizise the model already?
Thanks a lot for your help