shouxieai / infer

A new tensorrt integrate. Easy to integrate many tasks
MIT License
376 stars 76 forks source link

NVInfer: 1: [genericReformat.cu::executeMemcpy::1455] Error Code 1: Cuda Runtime (invalid argument) #26

Open LINTAO5835 opened 9 months ago

LINTAO5835 commented 9 months ago
(base) cvai@ubuntu:~/yolov8/infer-main$ make run
Compile depends CXX src/main.cpp
Compile CXX src/main.cpp
Link workspace/pro
[infer.cu:393]: Infer 0xffff5c000db0 [StaticShape]
[infer.cu:405]: Inputs: 1
[infer.cu:409]:     0.images : shape {1x3x640x640}
[infer.cu:412]: Outputs: 4
[infer.cu:416]:     0.onnx::Reshape_577 : shape {1x66x80x80}
[infer.cu:416]:     1.onnx::Reshape_588 : shape {1x66x40x40}
[infer.cu:416]:     2.onnx::Reshape_599 : shape {1x66x20x20}
[infer.cu:416]:     3.output0 : shape {1x8400x6}
[infer.cu:209]: NVInfer: 1: [genericReformat.cu::executeMemcpy::1455] Error Code 1: Cuda Runtime (invalid argument)
[yolo.cu:597]: Failed to tensorRT forward.
[infer.cu:209]: NVInfer: 3: [executionContext.cpp::enqueueInternal::622] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::enqueueInternal::622, condition: bindings[x] || nullBindingOK
)
[yolo.cu:597]: Failed to tensorRT forward.
[infer.cu:209]: NVInfer: 3: [executionContext.cpp::enqueueInternal::622] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::enqueueInternal::622, condition: bindings[x] || nullBindingOK
)
[yolo.cu:597]: Failed to tensorRT forward.
[infer.cu:209]: NVInfer: 3: [executionContext.cpp::enqueueInternal::622] Error Code 3: API Usage Error (Parameter check failed at: runtime/api/executionContext.cpp::enqueueInternal::622, condition: bindings[x] || nullBindingOK

Who knows what I'm supposed to do with this? I have four outputs, and I think this is the one that's broken, so how do I change that to use the last output?