search

autodeployai / ai-serving

Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints
Apache License 2.0
144 stars 31 forks source link

i can not Deploy the ONNX model into AI-Serving #12

Closed shixinlishixinli closed 1 year ago

shixinlishixinli commented 1 year ago

the mnist model can not be download by wget. so i down load mnist-1.onnx from this link (https://github.com/onnx/models/tree/main/vision/classification/mnist)

Test the server availability is ok

The depoyment response: {'error': 'Error code - ORT_NOT_IMPLEMENTED - message: Could not find an implementation for the node Block386:Div(1)'}

Best Lisa Shi

scorebot commented 1 year ago

The error is thrown by the ONNX Runtime because:

ONNX Runtime only *guarantees* support for models stamped with opset version 7 or above for opset domain 'ai.onnx'. Please upgrade your model to opset 7 or higher. For now, this opset 1 model may run depending upon legacy support of some older opset version operators.

Your model mnist-1.onnx is just based on opset version 1, so you need to try the models that are greater or equal opset 7.

shixinlishixinli commented 1 year ago

your solution is worked, thank you so much