search

microsoft / onnxjs

ONNX.js: run ONNX models using JavaScript
Other
1.75k stars 130 forks source link

when is int8/opset 11 support expected? #235

Open saurabhtangri opened 3 years ago

saurabhtangri commented 3 years ago

when is int8/opset 11 support expected?

28Smiles commented 3 years ago

javascript has no int8 types, the only use for int8 in onnxjs would be to reduce the size of the models parameters (quantisation) or with the wasm simd instructions to increase throughput. I once implemented the quantize linear op and tested it. It seemed to work, but my model was not compatible, i could search for it and start a pull request tho.