tobegit3hub / simple_tensorflow_serving

Generic and easy-to-use serving service for machine learning models
https://stfs.readthedocs.io
Apache License 2.0
757 stars 193 forks source link

Add onnx support for pytorch backend #36

Closed wrongtest-intellif closed 3 years ago

wrongtest-intellif commented 5 years ago

Since ONNX currently is not a matured project, sometimes the onnx model produced by pytorch can not be inferenced with mxnet-onnx currently for various reasons. Add support for official pytorch&caffe2 onnx module should benefit. https://pytorch.org/docs/stable/onnx.html Note that the module depends on pytorch integrated with caffe2