search

DerryHub / BEVFormer_tensorrt

BEVFormer inference on TensorRT, including INT8 Quantization and Custom TensorRT Plugins (float/half/half2/int8).
Apache License 2.0
430 stars 71 forks source link

trt evaluate error #40

Open HerrYu123 opened 1 year ago

HerrYu123 commented 1 year ago

Hi, I met an error while using sh samples/bevformer/plugin/tiny/trt_evaluate.sh. It seems like something went wrong during context = engine.create_execution_context() and I found the context is None.

  File "tools/bevformer/evaluate_trt.py", line 173, in <module>
    main()
  File "tools/bevformer/evaluate_trt.py", line 119, in main
    inputs, outputs, bindings = allocate_buffers(
  File "/root/autodl-tmp/BEVFormer_tensorrt/./det2trt/utils/tensorrt.py", line 51, in allocate_buffers
    context.set_binding_shape(binding_id, dims)
AttributeError: 'NoneType' object has no attribute 'set_binding_shape'
DerryHub commented 1 year ago

https://github.com/DerryHub/BEVFormer_tensorrt/blob/e71ec129c89c7e1cdf2660a6023041fbbeb534fe/tools/bevformer/evaluate_trt.py#L39 Please set the log level to VERBOSE and you can see how the error happened.

HerrYu123 commented 1 year ago

Thanks for your reply. I got the following information.

[03/03/2023-17:17:08] [TRT] [E] 1: [raiiMyelinGraph.h::RAIIMyelinGraph::24] Error Code 1: Myelin (Compiled against cuBLASLt 11.5.1.0 but running against cuBLASLt 11.3.0.0.)

It seems like the version of CUDA(11.4) is not compatible with that of TensorRT(8.5.1.7) in my environment. I'll try to debug it later.

Alex-fishred commented 8 months ago

I encountered the same problem, how did you solve it? My environment is exactly the same as the author's