How to deploy the quantized model?

zhutmost / lsq-net

Unofficial implementation of LSQ-Net, a neural network quantization framework

MIT License

276 stars 40 forks source link

How to deploy the quantized model? #15

Open jiinhui opened 3 years ago

jiinhui commented 3 years ago

When we have trained the quantization model, how to deploy it in cpu backend?

zhutmost commented 3 years ago

For research proposes, you can run it with cpu backend by just modifying the config yaml. I am not similar with deployment in production environment. Maybe you can use the saved checkpoints to re-construct your model (or export it in ONNX)?