search

we0091234 / yolov7-face-tensorrt

yolov7-face tensorrt
43 stars 7 forks source link

TRT Problem #3

Open SwEngine opened 1 year ago

SwEngine commented 1 year ago

When I run onnx2trt, I got the output below:

[03/03/2023-06:51:38] [W] [TRT] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:377: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:38] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-06:51:39] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[03/03/2023-07:02:44] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
[03/03/2023-07:02:44] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
[03/03/2023-07:02:44] [W] [TRT] Check verbose logs for the list of affected weights.
[03/03/2023-07:02:44] [W] [TRT] - 76 weights are affected by this issue: Detected subnormal FP16 values.
[03/03/2023-07:02:44] [E] [TRT] 3: [builder.cpp::~Builder::307] Error Code 3: API Usage Error (Parameter check failed at: optimizer/api/builder.cpp::~Builder::307, condition: mObjectCounter.use_count() == 1. Destroying a builder object before destroying objects it created leads to undefined behavior.
)
convert seccuss!

And When I run yolov7-face, I got the output below:

[03/03/2023-07:11:03] [E] [TRT] 3: [runtime.cpp::deserializeCudaEngine::36] Error Code 3: API Usage Error (Parameter check failed at: runtime/rt/runtime.cpp::deserializeCudaEngine::36, condition: (blob) != nullptr
)
yolov7_face: /content/yolov7-face-tensorrt/yolov7-face.cpp:116: int main(int, char**): Assertion `engine_det != nullptr' failed.

What can be the problem?