I tried training hrnet32_ocr128 with mixed precision, although the training time and memory on
gpu has reduced but there is no reduction in the inference speed.
1) Can you suggest where I am going wrong.
2) By what other meas I can decrease the inference speed.
I tried training hrnet32_ocr128 with mixed precision, although the training time and memory on gpu has reduced but there is no reduction in the inference speed.
1) Can you suggest where I am going wrong. 2) By what other meas I can decrease the inference speed.