inisis / OnnxSlim

A Toolkit to Help Optimize Onnx Model
MIT License
71 stars 8 forks source link

量化我的onnx文件时出现,AttributeError: FLOAT8E4M3FN #16

Closed scuizhibin closed 2 months ago

scuizhibin commented 3 months ago

环境版本 onnx 1.13.0 onnx-graphsurgeon 0.3.12 onnxruntime 1.18.0 onnxslim 0.1.29 numpy 1.21.0

bevformer.zip

inisis commented 3 months ago

This is a compatiblity problem, please upgrade your onnx version to 1.16.

scuizhibin commented 3 months ago

bevformerencodertrt.zip 这个是优化前的onnx,使用tensorrt8.5.2量化是没有问题的,但是使用onnxslim优化过后 就会出现问题 operation.cpp:203: DCHECK(!i->is_use_only()) failed.

scuizhibin commented 3 months ago

这个是TENSORRT版本问题,降低版本就行使用8.4。