PINTO0309
commented
3 months ago I was traveling for work far away yesterday and could not reply.
- Cannot access Google Drive.
- Tell me what type of input data
(36,17,2)is. No one but you knows whetherNCWorNWCor others is the correct answer. Is it image, audio, or text? I cannot do a survey unless I know what the data means and the correct dimensional arrangement. -
What exactly is the type of model you want to use, the model with
INT16activation or the model withUINT8activation? Depending on the answer to this question, the outcome of the response will depend on whether it can or cannot be addressed. The following warning message is due to a poor TensorFlow implementation. Therefore, it is not an onnx2tf problem.RuntimeError: Max and min for dynamic tensors should be recorded during calibration: Failed for tensor arg1 Empty min/max for tensor arg1 WARNING: Full INT8 Quantization with int16 activations tflite output failed.If it does not have to be an
INT16activation, then the logic below makes no sense.converter.target_spec.supported_ops = \ [ tf.lite.OpsSet.EXPERIMENTAL_TFLITE_BUILTINS_ACTIVATIONS_INT16_WEIGHTS_INT8, # <--- here tf.lite.OpsSet.TFLITE_BUILTINS ] - I have no idea what the real cause of the error is until I see ONNX, but this error that
edgetpu-compilieris outputting is most likely aedgetpu-compilierproblem. While onnx2tf was originally designed to avoid suchedgetpu-compiliererrors as much as possible, there is still a possibility that I may need an unknown workaround, and in the worst case, a small workaround may not be able to handle it.ERROR: Attempting to use a delegate that only supports static-sized tensors with a graph that has dynamic-sized tensors. - The version of your associated package is quite old. Make sure to update your package version before working on it. The package version you are using has a fatal bug that corrupts the ONNX files.
https://github.com/PINTO0309/onnx2tf?tab=readme-ov-file#1-install
pip install -U simple_onnx_processing_tools \ && pip install -U sne4onnx>=1.0.13 \ && pip install -U sng4onnx>=1.0.4 \ && pip install -U onnx2tf \ && pip install -U tensorflow==2.16.1Related error messages. The onnxruntime is aborting.
WARNING: [ONNXRuntimeError] : 2 : INVALID_ARGUMENT : Failed to load model with error: /onnxruntime_src/onnxruntime/core/graph/model.cc:179 onnxruntime::Model::Model(onnx::ModelProto&&, const onnxruntime::PathString&, const onnxruntime::IOnnxRuntimeOpSchemaRegistryList*, const onnxruntime::logging::Logger&, const onnxruntime::ModelOptions&) Unsupported model IR version: 10, max supported IR version: 9
Outdated versions of packages lead to inducing a number of problems that are different from the essential problems. Therefore, it is recommended that the latest package with numerous bug fixes be used before beginning to investigate and address the problem.
The issue you shared with us still lacks quite a bit of information needed to begin the investigation.
karen-ca
Issue Type
Others
OS
Linux
onnx2tf version number
1.20.0
onnx version number
1.16.1
onnxruntime version number
1.17.1
onnxsim (onnx_simplifier) version number
0.4.33
tensorflow version number
2.13.0
Download URL for ONNX
Parameter Replacement JSON
Description
We are company using raspberry pi 5 + coral tpu to run models for our main product. If we can not get this full integer quantized model we can not map it to coral tpu and our project will fail. Could you help us, please? Thank you!
I am trying to quantize my ActivityAI4.onnx model to full integer quantized model using the following command
onnx2tf -i exports/onnx/ActivityAI4.onnx -oiqt -cind input gen/st.npy [0.40510672] [0.18647602]my model input size is (36,17,2), st.npy shape is (5,36,17,2). It is holding numpy array with stacked 5 arrays (36,17,2). The mean and std I calculated with the following commandsnp.load('gen/st.npy').mean()np.load('gen/st.npy').std()This is giving me the following error:
Here is quantization script
Here is not mapping error